WO2022123732A1 - Dispositif de traitement, dispositif de collecte d'informations, procédé de traitement d'informations, et programme - Google Patents

Dispositif de traitement, dispositif de collecte d'informations, procédé de traitement d'informations, et programme Download PDF

Info

Publication number
WO2022123732A1
WO2022123732A1 PCT/JP2020/046084 JP2020046084W WO2022123732A1 WO 2022123732 A1 WO2022123732 A1 WO 2022123732A1 JP 2020046084 W JP2020046084 W JP 2020046084W WO 2022123732 A1 WO2022123732 A1 WO 2022123732A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
unit
image
processing
output
Prior art date
Application number
PCT/JP2020/046084
Other languages
English (en)
Japanese (ja)
Inventor
謙 藤原
Original Assignee
ウミトロン ピーティーイー エルティーディー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ウミトロン ピーティーイー エルティーディー filed Critical ウミトロン ピーティーイー エルティーディー
Priority to PCT/JP2020/046084 priority Critical patent/WO2022123732A1/fr
Publication of WO2022123732A1 publication Critical patent/WO2022123732A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01K—ANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
    • A01K61/00—Culture of aquatic animals
    • A01K61/10—Culture of aquatic animals of fish
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A40/00—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production
    • Y02A40/80—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in fisheries management
    • Y02A40/81—Aquaculture, e.g. of fish

Definitions

  • the present invention relates to a processing device, an information collecting device, an information processing method, and a program used together with a target device having an image acquisition unit for acquiring an image of aquatic animals being raised.
  • Patent Document 1 describes a growth state monitoring method for monitoring the growth state of aquatic animals growing in an aquarium, and the position of the aquatic animal in the aquarium using images detected from two imaging systems. And what is required for size is disclosed.
  • the output of information has various aspects such as storage of information in a storage unit, transmission of information through a network, and output by image or sound using a display device, a sound output device, or the like. It is a concept that includes things.
  • the processing device of the first invention is a processing device used together with a target device having an image acquisition unit for acquiring an image of aquatic animals being raised, and information based on an image acquired by the image acquisition unit from the target device. It is a processing device having a receiving unit for receiving the above, an output unit for outputting information based on the information received by the receiving unit, and a power supply unit for supplying electric energy to the target device.
  • the processing apparatus of the second invention further has an output information acquisition unit for acquiring information for use in another apparatus by using the information received by the receiving unit for the first invention.
  • the output unit is a processing device that outputs the information acquired by the output information acquisition unit.
  • the receiving unit receives two or more images acquired by the image acquisition unit, and the output information acquisition unit receives predetermined image selection conditions. Based on the above, among the images received by the receiving unit, the processing device acquires a smaller number of images than the number of images received by the receiving unit.
  • the output information acquisition unit is located from the position of the aquatic animal in the image taken immediately before among the images received by the receiving unit. It is a processing device that acquires an image of an aquatic animal at a position displaced by a certain amount or more.
  • the output information acquisition unit is based on one or more images received by the receiving unit, and the aquatic animal being raised. It is a processing device that acquires information about.
  • the output information acquisition unit acquires the environmental information regarding the breeding environment of the aquatic animal, and the aquatic animal being raised based on the acquired environmental information. It is a processing device that acquires information about.
  • the processing apparatus of the seventh invention has, for any one of the first to sixth inventions, a device identifier acquisition unit that acquires a device identifier that identifies the target device that is the source of the information received by the receiving unit.
  • the output unit is a processing device that outputs information based on the information received by the receiving unit in association with the acquired device identifier.
  • the processing apparatus of the eighth invention further has a position identifier acquisition unit for acquiring a position identifier for identifying a position where an image is acquired by the image acquisition unit for any one of the first to seventh inventions.
  • the output unit is a processing device that outputs the information based on the information received by the receiving unit in association with the acquired position identifier.
  • the processing apparatus of the ninth invention further has a transmission unit capable of transmitting information to an external device for any one of the first to eighth inventions, and the output unit is external by the transmission unit. It is a processing device that outputs information to the device.
  • the information acquired at the breeding place can be easily transmitted to an external device.
  • the output unit outputs information when the electric energy is not supplied from the power supply unit to the target device. It is a processing device to perform.
  • the power supply unit has a secondary battery, and the output unit is based on the electric energy supplied from the outside.
  • a processing device that outputs information when the next battery is being charged or fully charged.
  • the processing apparatus of the twelfth invention has each part in a cartridge housing that can be detachably attached to the attachment part formed in the target device for any one of the first to eleventh inventions. It is a processing device that is housed and configured.
  • the output unit outputs information when the processing apparatus is removed from the target device, and the processing apparatus becomes the target device. It is a processing device that does not output information when it is attached.
  • the processing apparatus of the fourteenth invention has an instruction storage unit for storing control instructions for controlling the operation of the image acquisition unit and a control instruction for any one of the first to thirteenth inventions. It is a processing device further including a target control unit that controls the operation of the image acquisition unit based on the above.
  • the operation of the image acquisition unit can be controlled by using the processing device.
  • the processing apparatus of the fifteenth invention is a processing apparatus for the fourteenth invention, in which the control instruction includes an instruction regarding the timing of acquiring an image of an aquatic animal.
  • the information collecting device of the sixteenth invention relates to aquatic animals under breeding, which are provided with a processing device and a target device to which the processing device is attached for any one of the first to fifteenth inventions. It is an information collecting device for collecting information.
  • the information collecting device of the seventeenth invention has the first process of acquiring information based on the image acquired by the image acquisition unit in the subject device with respect to the sixteenth invention.
  • Information It is a collecting device.
  • the first processing unit collects a smaller number of images from the images acquired by the image acquisition unit than the number of acquired images.
  • An image selection process for acquiring an image based on a predetermined image selection condition is performed, the receiving unit receives the image acquired by the image selection process, and the second processing unit is an information collecting device which is an output information acquisition unit. ..
  • the information acquired at the growing place can be easily output.
  • FIG. 1 Schematic diagram of the aquatic animal detection system according to the first embodiment of the present invention.
  • Block diagram of the aquatic animal detection system Block diagram of the information processing device Perspective view showing an example of the camera The figure explaining the detection work using the camera
  • Flow chart showing an example of the detection process Flow chart showing an example of judgment operation
  • the figure explaining an example of the operation of the same organism information storage part A diagram showing an example of time-series biological information stored in the same biological information storage unit.
  • FIG. 1 A table explaining the operation of the feeding instruction information generation unit A flowchart showing an example of the operation related to the correction of model information by the processing unit.
  • Block diagram of aquatic animal detection system according to one modification of Embodiment 1 Block diagram of the information processing device Schematic diagram of the aquatic animal detection system according to the second embodiment of the present invention.
  • Block diagram of the aquatic animal detection system Perspective view showing the schematic configuration of the camera unit Perspective view showing an arrangement example of the camera Schematic diagram of the aquatic animal detection system according to the third embodiment of the present invention.
  • Block diagram of the aquatic animal detection system The figure which shows the hardware composition of the information gathering apparatus in Embodiment 4 of this invention.
  • FIG. 1 Perspective view showing the hardware configuration of the processing device Schematic diagram of aquatic animal detection system using the same information collection device Block diagram of the aquatic animal detection system Block diagram showing the configuration of the core control unit of the processing device A flowchart showing an example of the operation of the processing device. A flowchart showing a modified example of the operation of the processing device. A flowchart showing an example of the output information acquisition process of the output information acquisition unit. Overview of the computer system in the above embodiment Block diagram of the computer system
  • the aquatic animal is, for example, a fish, but is not limited to this, and any animal such as a crustacean or a shellfish that lives in water may be used.
  • any animal such as a crustacean or a shellfish that lives in water may be used.
  • aquatic animals when aquatic animals are described, they are sometimes referred to as fish on behalf of them, and the bodies of the aquatic animals are sometimes referred to as fish bodies.
  • the image is, for example, a still image or a moving image taken by a camera, but is not limited to this.
  • it may be a still image extracted from a moving image taken by a camera.
  • the aquatic animal detection system can be used, for example, in a cage (aquaculture farm) where aquatic animals are cultivated.
  • the farm may be the sea, a lake, a pond, a river, or the like.
  • a fish cage is an area filled with water (whether freshwater, seawater, brackish water) for aquatic animals, that is, a farm.
  • the environment of the farm may be different depending on the type of aquatic animals to be cultivated.
  • the farm may be naturally formed or artificially created.
  • the farm may be a large aquarium for aquaculture filled with water, whether outdoors or indoors.
  • a plot composed of a part of an area with water may be called a farm.
  • the identifier is a character or code that uniquely indicates the item.
  • the identifier is, for example, an ID, but any kind of information can be used as long as it is information that can identify the corresponding item. That is, the identifier may be the name of what it indicates, or it may be a combination of codes so as to uniquely correspond to each other.
  • the acquisition may include acquiring the matters input by the user or the like, or may include acquiring the information stored in another device.
  • Acquiring the information stored in the other device may include acquiring the information stored in the other device via API or the like, or the document file provided by the other device. It may include acquiring the content (including the content of the web page) by performing scraping or the like. Further, it may include acquiring information in a format different from the original information based on the original information, such as acquiring information by performing optical character reading on an image file.
  • a so-called machine learning method may be used to acquire information.
  • a learning device that inputs a specific type of input information and outputs the output information of the type to be acquired is configured by using a machine learning method.
  • a machine learning method For example, two or more sets of input information and output information are prepared in advance, and the two or more sets of information are given to a module for constructing a learning device for machine learning to configure a learning device, and the configured learning device is provided. Accumulate in the storage.
  • the learner can also be called a classifier.
  • the machine learning method may be, for example, deep learning, random forest, SVR, or the like.
  • functions in various machine learning frameworks such as fastText, tinySVM, random forest, TensorFlow, and various existing libraries can be used.
  • the learner can also be called a classifier.
  • Outputting information means displaying on a display, projecting using a projector, printing with a printer, sound output, transmission to an external device, storage on a recording medium, processing to other processing devices or other programs. It is a concept that includes delivery of results. Specifically, for example, it includes enabling display of information on a web page, sending it as an e-mail, and outputting information for printing.
  • Information reception means receiving information input from input devices such as keyboards, mice, and touch panels, receiving information transmitted from other devices via wired or wireless communication lines, optical disks, magnetic disks, and semiconductors. It is a concept including acceptance of information read from a recording medium such as a memory.
  • the aquatic animal detection system is used to detect the number and growth state of aquatic animals such as fish during aquaculture.
  • the detection device of the aquatic animal detection system detects the fish body in the image taken by the camera.
  • Notification is performed, for example, by outputting voice or generating vibration from a terminal device used in an aquatic animal detection system or a device linked to the terminal device, but the notification is not limited to this.
  • the notification may be made, for example, in a terminal device having a display unit for displaying an image taken by a camera in an aquatic animal detection system.
  • the information processing device of the aquatic animal detection system acquires the detection information of the fish body detected by the detection device and the environment information corresponding to the captured image, and stores the detection information and the environment information in association with each other. Judgment regarding the growth state of fish is made based on the accumulated information, and the judgment result is output.
  • the predetermined notification condition includes the progress of detection of the fish body.
  • the predetermined notification condition may include the total number of fish detected in the image.
  • the predetermined notification conditions may include those relating to the positional relationship between the fish body and the camera.
  • the detection device may be configured to measure the fish body and give a notification based on the result.
  • the camera is a stereo camera, and a fish body included in an image taken by the stereo camera is detected, but the present invention is not limited to this.
  • the information processing apparatus may make a determination regarding growth abnormality based on time-series biological information and feeding information. Further, the information processing apparatus may output the feeding instruction information based on the determination result regarding the growth state, and may output the feeding instruction information based on the growth plan information and the determination result of the growth state. May be good.
  • the information processing device may make a determination to acquire biological information for each cage and output the determination result, or may output unfinished cage information for identifying the cage for which the determination has not been completed. ..
  • the information processing apparatus may determine whether or not the growth state of the aquatic animal meets the preset shipping standard.
  • FIG. 1 is a schematic diagram of the aquatic animal detection system 1 according to the first embodiment of the present invention.
  • the reference numeral P indicates a cage provided in the sea or the like
  • the reference numeral P1 indicates a constituent member constituting the cage P (for example, a net surrounding the cage P).
  • the aquatic animal detection system 1 includes an information processing device 10, a terminal device 60, a camera unit 80, and an information input device 90.
  • the information processing device 10 also functions as the aquatic animal detection device 10D, but the present invention is not limited to this.
  • the information processing device 10 and the information input device 90 are devices on the remote side (so-called ASP side), and the terminal device 60 and the camera unit 80 are devices on the local side (raw cage P side). I can say.
  • the information processing device 10 and the terminal device 60 can communicate with each other via a network such as the Internet. Further, the information processing device 10 and the information input device 90 can communicate with each other via a network.
  • the camera unit 80 is connected to the terminal device 60.
  • the information processing device 10, the terminal device 60, and the information input device 90 are each connected to a network such as the Internet, but the present invention is not limited to this.
  • the information processing device 10 and the terminal device 60 may be connected to the network, and the information input device 90 may be connected to the information processing device 10.
  • the camera unit 80 may be connected to a network, and the camera unit 80 and the terminal device 60 may be connected via the network.
  • a server device may be provided on the local side, and another local device may be connected to the server device.
  • the information processing device 10 and the information input device 90 may be provided as one of the devices on the local side, and each device does not distinguish between the local side and the remote side, and is an aquatic animal as described below. It suffices if they are connected to each other so that the detection system 1 can operate.
  • a tablet-type information terminal device is shown as a terminal device 60
  • a laptop computer-type device is shown as an information input device 90
  • these devices may be, for example, tablet-type information terminal devices, portable information terminal devices such as so-called smartphones, or personal computers (PCs) such as laptop computers, or devices other than these. You may.
  • the information input device 90 is, for example, a general laptop computer type information terminal device.
  • the information input device 90 is realized from a storage unit, an MPU, a memory, etc. in which various information and programs are stored, and a processing unit and an information input device 90 that perform various processes by executing the program are networked. It has a communication unit and the like that are connected to and controlled so that communication with other devices connected to the network can be performed.
  • a web browser function can be made to function, or an information transmission / reception function such as e-mail can be made to function.
  • the user of the information input device 90 can browse the information received from another device connected to the network, or cause the information input device 90 to transmit the information to the other device. Can be done.
  • the camera unit 80 has a jig 87 to which the camera 81 is attached and which the user (detection worker) can grasp by hand.
  • the jig 87 is a part of the camera unit 80 other than the camera 81.
  • the jig 87 has an arm portion 88 for submerging and holding the camera 81 in water.
  • the shape and configuration of the jig 87 are not limited to this. Further, a configuration in which the camera 81 is suspended via a wire or the like may be adopted.
  • the user goes to the fish cage P where the fish to be detected is located, and uses the terminal device 60 and the camera unit 80 connected to the terminal device 60 to perform the detection operation for the fish in the cage P. ..
  • the aquatic animal detection system 1 exchanges information as follows. That is, the image taken by the camera 81 and the information acquired by the camera unit 80 are input to the terminal device 60.
  • the terminal device 60 transmits information such as an image (for example, information such as an image, sensor measurement information, and position information, but is not limited to this) to the information processing device 10 via a network. do.
  • the information input device 90 includes various input data (for example, information on fish species, number of growing days, feeding amount, weather history, water quality history, etc., but is not limited to this). Is transmitted to the information processing apparatus 10.
  • the information processing apparatus 10 performs detection processing, determination processing related to the growth state, and the like, and information indicating the results (information such as fish size, weight, notification information, determination result, etc.) (Not limited) is transmitted to the terminal device 60.
  • the terminal device 60 can receive the transmitted information and output it to the user.
  • FIG. 2 is a block diagram of the aquatic animal detection system 1.
  • FIG. 3 is a block diagram of the information processing apparatus 10.
  • the information processing apparatus 10 includes a receiving unit 18, a transmitting unit (an example of a notification output unit) 19, a storage unit 21, and a processing unit 30.
  • the receiving unit 18 and the transmitting unit 19 connect the information processing device 10 to the network and perform communication with other devices connected to the network.
  • the receiving unit 18 and the transmitting unit 19 may be configured to perform wireless communication using, for example, wireless LAN or data communication of a mobile phone, or may be configured to perform various types of wired communication. May be good.
  • the receiving unit 18 receives information transmitted from another device.
  • the receiving unit 18 stores the received information in, for example, the storage unit 21 or hands it over to the processing performed by the processing unit 30.
  • the transmission unit 19 transmits information to another device.
  • the transmission unit 19 transmits, for example, the information stored in the storage unit 21 or the information handed over from the processing unit 30.
  • the transmission unit 19 functions as, for example, a notification output unit that transmits the notification information generated by the notification generation unit 36 as described later.
  • the storage unit 21 is realized by a non-volatile recording medium, it can also be realized by a volatile recording medium.
  • Information acquired by each part of the processing unit 30 as described later is stored in each part of the storage unit 21, but the process of storing information or the like in each part of the storage unit 21 is not limited to this. ..
  • information or the like may be stored in the storage unit 21 via a recording medium, or information or the like transmitted via a communication line or the like may be stored in the storage unit 21.
  • the information or the like input via the input device may be stored in the storage unit 21.
  • the storage unit 21 includes a notification condition storage unit 22 and a second notification condition storage unit 23.
  • Notification conditions are stored in the notification condition storage unit 22.
  • the notification condition is used when determining whether or not to notify the user performing the detection work regarding the detection work when the detection work is executed.
  • Notification conditions are preset. It may be set prior to the user's detection work, or it may be set by being specified by the user at the start of the detection work or during the work, or based on the information acquired by the information processing apparatus 10. It may be set automatically.
  • the notification condition includes a condition relating to the progress of detection of aquatic animals.
  • the notification condition includes a condition relating to the total number of aquatic animals detected by the detection operation (detection number).
  • the notification conditions include the degree of achievement of the current number of detections with respect to the final achievement value of the number of detections (when the number of detections 100 is set as a goal, the current number of detections is 10%, 20%, and so on. It may be (such as what has been reached). For example, when performing detection work for the purpose of measuring the size of aquatic animals growing in one cage, if the number of detections exceeds a predetermined number, it is statistically effective to indicate the size of aquatic animals.
  • the number can be set as a notification condition. Further, in this case, for example, a measurement result having a predetermined confidence interval (for example, a section of 3 sigma) using a measured value obtained by measurement and a value such as a standard deviation calculated using the measured value.
  • the number of detections that can be obtained may be calculated at any time as the detection work of aquatic animals progresses (for example, it may be calculated by the detection processing unit 31 described later) and set as a notification condition. ..
  • the notification condition may include a condition relating to the positional relationship between the camera 81 and the aquatic animal detected from the image.
  • the positional relationship is, for example, the orientation of the camera 81 with respect to the posture of the aquatic animal (for example, the orientation of the aquatic animal which is a fish), the distance between the aquatic animal and the camera 81, and the like, but is not limited thereto. ..
  • the second notification condition is stored in the second notification condition storage unit 23.
  • the second notification condition is a condition related to the measurement result of aquatic animals, which is performed at the time of executing the detection work, as described later. That is, the second notification condition is, for example, the size of the aquatic animal (fish body length (the length from the tip to the rear end of the tail fin, but may have a different definition)) and the fish body height (dorsal side). The size of the fish from to the ventral side, but may have a different definition), the width of the fish (the width between both sides of the fish, but may have a different definition), It is a predetermined threshold or the like defined for the measurement result of body weight (weight), etc.
  • the second notification condition is not limited to these.
  • the second notification condition regarding the feature amount is It may be set.
  • the storage unit 21 includes a biological information storage unit 24, a model information storage unit 25, a feeding information storage unit 26, a growth plan information storage unit 27, and a shipping standard information storage unit 28.
  • the biological information is stored in the biological information storage unit 24.
  • the biological information is information acquired by the biological information acquisition unit 42, as will be described later. That is, the biological information is information acquired based on an image, and may be a measured value for aquatic animals detected in the detection work or an arbitrary feature amount related to the size of the fish, or in the detection work. The information may be obtained based on the number of detected aquatic animals and the like.
  • Model information is stored in the model information storage unit 25.
  • Model information is a reference value for the growth of aquatic animals.
  • the model information includes, for example, the transition of time for aquatic animals (for example, the number of growth (for example, DOC (Day of Culture; the number of growth days since the fry was placed in the aquaculture cage)), the number of days elapsed after hatching, and the like. ) And the standard relationship between the index indicating the growth of the body. More specifically, for example, for a fish, it means a value in which the DOC is associated with the standard fish body length, average weight, and the like.
  • the reference value may be summarized in a table or may be a growth curve represented by, for example, a mathematical formula. Note that the model information is not limited to such an existing growth curve model.
  • a known growth curve model may be a growth curve model corrected by utilizing time-series biological information stored in the biological information storage unit 24.
  • the model information may be the environment of the aquatic animal. (For example, it may be prepared according to the water temperature and the water quality (oxygen concentration, pH, etc.).
  • Feeding information is stored in the feeding information storage unit 26.
  • the feeding information is information related to feeding to the cage, and more specifically, for example, information such as the time of feeding and the amount of feeding (feeding start / end time, daily feeding amount, monthly feeding amount). , Feeding interval, etc.).
  • the feeding information may also include, for example, an identifier that identifies the fed food, information on the properties of the food (pellet size, fishmeal content, etc.), and the like.
  • the growth plan information storage unit 27 stores growth plan information indicating a preset growth plan.
  • the growth plan information is, for example, a target value of an index indicating the growth of the body, which is associated with the transition of time for aquatic animals.
  • the growth plan information can be set, for example, in the model information based on the characteristics of the aquatic animal as a seedling, the characteristics of the environment of the cage, and the like, but the information is not limited to this.
  • the growth plan information may be set based on, for example, the time and size of aquatic animals expected to be shipped.
  • the shipping standard information storage unit 28 stores shipping standard information indicating a preset shipping standard.
  • the shipping standard information is information indicating shipping standards, and is, for example, information indicating the size, weight, sales time, etc. requested by the shipping destination (sales destination) of aquatic animals, but is not limited to this.
  • the processing unit 30 includes a detection processing unit 31 and an information processing unit 40.
  • the processing unit 30 controls the operation of the information processing device 10 and performs processing in cooperation with the terminal device 60 and the like. Coordination with a device connected via a network, such as a terminal device 60, can be performed by transmitting a command to each device, receiving information from each device, and the like.
  • the processing unit 30 can usually be realized from an MPU, a memory, or the like.
  • the processing procedure of the processing unit 30 is usually realized by software, and the software is recorded in a recording medium such as ROM. However, it may be realized by hardware (dedicated circuit).
  • the detection processing unit 31 mainly performs processing related to the detection work.
  • the detection processing unit 31 includes an image acquisition unit 32, a detection unit 33, a measurement unit 34, a notification determination unit 35, and a notification generation unit 36.
  • the measurement unit 34 is included in the detection unit 33, the measurement unit 34 is not limited to this.
  • the image acquisition unit 32 acquires an image taken by the camera 81.
  • the image is taken by the camera 81 and then immediately transmitted to the information processing device 10 via the terminal device 60. That is, the image acquisition unit 32 immediately acquires the image taken by the camera 81.
  • "immediate” does not necessarily mean that the time difference is extremely small, and may include some delay time and time for processing such as communication and image processing.
  • the image taken by the camera 81 does not have to be immediately transmitted to the information processing apparatus 10, for example, it may be transmitted periodically (at intervals of several seconds, at intervals of several minutes, at intervals of several hours, etc.), or at a predetermined event.
  • the image may be transmitted to the information processing apparatus 10 at the timing when the occurrence is detected by the terminal apparatus 60 or the like.
  • the detection unit 33 detects the aquatic animals shown in the image.
  • the detection unit 33 detects aquatic animals immediately after the image is taken.
  • the detection unit 33 reads out the image immediately acquired from the image acquisition by the image acquisition unit 32, and immediately detects the aquatic animal.
  • the detection of an individual aquatic animal by the detection unit 33 can be performed by various known methods.
  • the detection unit 33 extracts the contour of the object included in the image acquired by the image acquisition unit 32, compares the extracted contour with the contour information prepared in advance, and has a degree of similarity with the contour information of the aquatic organism. When is higher than a predetermined value, it can be determined that the object from which the contour is extracted is an aquatic animal.
  • the detection unit 33 inputs a region image including an object included in the image acquired by the image acquisition unit 32, and outputs information indicating whether or not the object is an aquatic animal for machine learning.
  • a learning device configured by the method may be used to detect whether or not the object included in the image is an aquatic animal.
  • the detection unit 33 has a measurement unit 34.
  • the measuring unit 34 measures the aquatic organisms shown in the image. In the present embodiment, the measuring unit 34 measures the size of an individual aquatic animal detected from an image by the detecting unit.
  • the measuring unit 34 measures, for example, the fish body length, but the present invention is not limited to this. For individual aquatic animals, various dimensions such as fish body length, fish body height, and fish body width may be measured, or any of these may be measured. Further, the measuring unit 34 may acquire the body weight of the aquatic animal based on the measured measured value.
  • the body weight indicates, for example, determining the body weight using table information in which the measured value and the body weight are associated in advance (for example, it may be stored in the storage unit 21), or showing the relationship between the measured value and the body weight.
  • the measuring unit 34 can be obtained by calculating using a function or by acquiring using a learner configured by a machine learning method in advance.
  • the fact that the measuring unit 34 acquires the body weight in this way can be said to measure the body weight.
  • the measuring unit 34 may acquire, for example, an arbitrary feature amount related to the size of the fish body (for example, the degree of hanging of the belly of the aquatic animal, the form of the aquatic animal, etc.).
  • the size of such aquatic animals can be measured by various known methods.
  • the measuring unit 34 may measure the dimensions based on the distance between a plurality of predetermined feature points detected for the object determined to be an aquatic animal as described above and the position of the feature points.
  • the measuring unit uses a learning device configured to input an image of an area having an object determined to be an aquatic organism and output a feature amount related to the size of the aquatic organism, and to obtain a measurement result. May be obtained.
  • the detection of aquatic animals is a concept including the detection of individual aquatic animals and the measurement of the size of the detected individuals.
  • the detection unit 33 detects an individual aquatic animal in the image
  • the measurement unit 34 measures the detected individual.
  • the detection and measurement of another individual are performed.
  • the detection of aquatic animals may be regarded as a concept that does not include the measurement of the size of individual aquatic animals. In this case, it can be said that the detection processing unit 31 detects the aquatic animal by the detection unit 33 and measures the size of the aquatic animal by the measurement unit 34.
  • the notification determination unit 35 determines whether or not the notification condition regarding the detection status of aquatic animals by the detection unit 33 is satisfied.
  • the detection status of aquatic animals is, for example, the number of detected aquatic animals when the detection of aquatic animals is started for one cage P. That is, for example, when the notification condition storage unit 22 is set as the notification condition that the number of detected animals has reached a predetermined number as described above, the notification determination unit 35 determines that the number of detected aquatic animals is increased. Determine if the notification conditions are met. When the number of detected aquatic animals reaches a predetermined number, the notification determination unit 35 determines that the notification condition is satisfied.
  • the notification determination unit 35 acquires information indicating the positional relationship as the detection status of the detection unit 33 and notifies the notification. It may be determined whether or not the conditions are met.
  • the detection status of aquatic animals may be, for example, the physical condition or activity amount of the detected individual, and in this case, items related to the physical condition or activity amount of the detected individual may be set as notification conditions. ..
  • the physical condition and activity amount of the aquatic animal can be detected, for example, by detecting a change in the movement or the like of the individual photographed at a predetermined time from the image. That is, in two or more images or moving images taken within a predetermined time, the distance traveled, the amount of change in posture, and the like are detected for one detected individual.
  • the body length and the amount of activity of the individual can be detected depending on whether or not the detected value exceeds a predetermined threshold value.
  • the detection method is not limited to this.
  • the notification determination unit 35 determines whether or not the second notification condition regarding the measurement result by the measurement unit 34 is satisfied. For example, when it is set as the second notification condition that the fish body length of the aquatic animal reaches a predetermined threshold value, the notification determination unit 35 determines whether or not the measured value of the individual aquatic animal has reached the predetermined threshold value. Judge. Then, when the measured value reaches a predetermined threshold value, the notification determination unit 35 determines that the second notification condition is satisfied. When a predetermined threshold value regarding the size of the aquatic animal is set as the second notification condition, the notification determination unit 35 compares the average value of the measured values of the detected individuals with the predetermined threshold value. It may be determined whether or not the second notification condition is satisfied.
  • the notification determination unit 35 determines that the measured value of each individual has reached a predetermined threshold value more than a predetermined number of times, and continuously determines that the measured value of each individual has reached a predetermined threshold value more than a predetermined number of times. If this happens, it may be determined that the second notification condition is satisfied.
  • the notification generation unit 36 generates notification information when it is determined by the notification determination unit 35 that the notification conditions are satisfied.
  • the notification information is information for notifying the user.
  • the notification information generated by the notification generation unit 36 is transmitted (an example of output) to the terminal device 60 by the transmission unit 19.
  • a notification is performed from the terminal device 60.
  • the user can be notified by outputting voice from the terminal device 60, generating vibration from the terminal device 60, or displaying information on the screen of the terminal device 60. ..
  • the notification information is, for example, information for notifying the user that the notification condition is satisfied.
  • the notification information can be generated, for example, as follows. For example, a predetermined message text associated with the notification condition in advance may be generated as notification information, or a predetermined variable related to the notification condition (indicated as "$ variable") may be used to "" total "$ variable. A message such as "The detection of animals is completed" may be generated as notification information.
  • the notification generation unit 36 generates the second notification information when it is determined by the notification determination unit 35 that the second notification condition is satisfied.
  • the second notification information like the notification information, is information for notifying the user, and is information transmitted to the terminal device 60 by the transmission unit 19.
  • the second notification information is information for notifying the user that the second notification condition is satisfied. That is, the user can know that the second notification condition is satisfied by performing the notification based on the second notification information.
  • the user receives the notification, and the fish body length of the aquatic animal reaches the level at which the second notification condition is satisfied in the cage P. You can know that.
  • the generation of the second notification information can be performed, for example, as follows. For example, a predetermined message text associated with the second notification condition in advance may be generated as the second notification information, or a predetermined variable (indicated as "$ variable") related to the second notification condition may be used to "" A message such as "The average fish length is" $ variable "is centimeters" may be generated as the second notification information.
  • the above-mentioned second notification condition may be interpreted as being included in the notification condition, or the notification condition may be interpreted as being included in the second notification condition.
  • the notification information may be interpreted as including the second notification information or also serving as the second notification information.
  • the second notification information may be interpreted as also serving as notification information.
  • the notification given to the user from the terminal device 60 based on the notification information transmitted from the information processing device 10 is a notification that the size of aquatic animals equal to or larger than a predetermined number has reached a predetermined threshold.
  • the notification information generated by the notification generation unit 36 can also be interpreted as the second notification information regarding the measured value of the size of the aquatic animal, and the notification condition in this case is the size of the aquatic animal. It can also be interpreted as including the second notification condition regarding the measured value.
  • the detection processing unit 31 constitutes the aquatic animal detection device 10D together with the notification condition storage unit 22 and the second notification condition storage unit 23 of the storage unit 21.
  • the information processing device 10 has the aquatic animal detection device 10D.
  • the information processing unit 40 performs processing based on the information obtained by the detection operation, as shown below.
  • the information processing unit 40 includes a status information acquisition unit 41, a biological information acquisition unit 42, a biological information storage unit 43, an unfinished cage determination unit 44, an unfinished cage information generation unit 45, a growth state determination unit 46, and a growth state determination unit 46.
  • a feeding instruction information generation unit 47 is provided.
  • the status information acquisition unit 41 acquires shooting status information regarding the shooting status of the image captured by the camera 81.
  • the shooting status information regarding the shooting status includes shooting time information regarding the time such as the time when the shooting was performed.
  • the shooting status information may include other information, and the information may be, for example, position information corresponding to the position of the camera 81 (that is, position information indicating the position of the raw cage P). It may be information indicating the weather or the like, or it may be environmental information such as information measured by the environment sensor 84 provided in the camera unit 80 as described later.
  • the photographing status information may include information on the cage P, such as information for identifying the cage P to be photographed and information indicating the nature of the cage P.
  • the position information may be, for example, information acquired by using a satellite-based positioning system (GPS) in the camera unit 80 or the terminal device 60, or information indicating a point such as an address specified in advance. May be. Further, the position information may be information input by the user via, for example, the terminal device 60 or the information input device 90. For example, the position information is acquired based on the information input by the user to specify the cage P to be photographed, the information for identifying the cage P in advance, and the information associated with the position information of the cage P. You may do so.
  • GPS satellite-based positioning system
  • the information indicating the weather or the like may be, for example, information such as sunny or cloudy, or information indicating temperature, wind speed, weather, precipitation, amount of solar radiation, wave height, or the like.
  • Environmental information includes, for example, information on water temperature, oxygen, ammonia, nitrate, nitrite, carbon dioxide, color and turbidity of seawater, concentration of biomass such as plankton, and other matters related to water quality. It is not limited to this.
  • the information that identifies the cage P is, for example, a cage identifier that can identify the cage P.
  • the information indicating the nature of the cage P includes, for example, information for specifying the seedlings of the aquatic animals being raised (fish species, seedling information, etc.), information on the breeding period, information on the number of fish at the start of growth, and information on the number of fish.
  • Various information such as information indicating the size of the cage P may be applicable.
  • the status information acquisition unit 41 may be able to acquire such shooting status information from, for example, input data transmitted from the information input device 90. In this case, it can be said that the information input by the user in the information input device 90 is acquired as the shooting status information. Further, the status information acquisition unit 41 may be able to acquire shooting status information from the information transmitted from the terminal device 60. In this case, the information automatically acquired by the terminal device 60 (for example, the information sent from the camera unit 80 to the terminal device 60) and the information input by the user in the terminal device 60 are acquired as shooting status information. Can be said.
  • the status information acquisition unit 41 may acquire shooting status information including feeding information.
  • the feeding information is, for example, information on the feeding work performed on the photographed aquatic animal.
  • the feeding information included in the acquired shooting status information is stored in, for example, the feeding information storage unit 26.
  • the biological information acquisition unit 42 acquires biological information related to aquatic animals detected by the detection unit 33.
  • the biological information is acquired by the detection unit 33 based on the image.
  • the information may be obtained based on the number of detected aquatic animals detected by the detection unit 33, or may be a measured value of the size of the aquatic animal.
  • the biological information storage unit 43 stores the biological information acquired by the biological information acquisition unit 42 in the biological information storage unit 24 in association with the shooting status information.
  • the biological information is at least associated with, for example, a cage identifier indicating the cage P in which the image corresponding to the biological information was captured, and the imaging time information.
  • time-series biological information is configured in the biological information acquisition unit 42. That is, the time-series biological information is biological information detected by the detection operation at a plurality of time points in the past.
  • the time-series biological information may include time-series growth history information and the like.
  • the time-series growth history information is information in which determination results (details will be described later) regarding the growth state of aquatic animals by the growth state determination unit 46 at a plurality of past time points are accumulated.
  • the unfinished cage determination unit 44 determines whether or not the aquatic animal detection work has been performed for each cage P at one detection opportunity.
  • one detection opportunity means an opportunity for collectively performing detection work on a plurality of cages P.
  • the detection opportunity information in which the date on which the detection work is performed and the cage identifier of the cage P on which the detection work should be performed are associated with each other is stored in the storage unit 21 or the like.
  • the unfinished cage determination unit 44 refers to, for example, the detection opportunity information, and extracts the cage identifier associated with the day when one detection operation is performed.
  • the unfinished cage determination unit 44 extracts the biometric identifier corresponding to the biological information determined to be the same day information based on the shooting time information from the biological information stored in the biological information storage unit 24. Then, the unfinished cage determination unit 44 compares the two cage identifiers with each other, and determines that the aquatic animal detection work was performed at one detection opportunity for the cage P from which the cage identifier corresponding to the biological information was extracted. It is determined that the cage P from which the cage identifier corresponding to the biological information has not been extracted is an unfinished cage in which the aquatic animal detection work has not been performed (the detection work has not been completed). That is, the unfinished cage determination unit 44 determines whether or not the cage is an unfinished cage for each cage P based on the cage identifier and the photographing time information corresponding to the biological information stored in the biological information storage unit 24.
  • the unfinished cage information generation unit 45 generates unfinished cage information for identifying the unfinished cage when there is an unfinished cage determined by the unfinished cage determination unit 44 that the detection operation has not been performed.
  • the unfinished cage information includes a cage identifier that identifies the unfinished cage.
  • the transmission unit 19 transmits the unfinished cage information to the terminal device 60.
  • the unfinished cage information is transmitted to the terminal device 60, for example, the information is displayed on the screen of the terminal device 60, and the user can be notified. The user can know that there is an unfinished cage and information on the unfinished cage by being notified based on the unfinished cage information.
  • the unfinished cage information may include position information indicating the position of the unfinished cage. In that case, the terminal device 60 displays the information indicating the position of the unfinished cage, so that the user can more easily know the location of the unfinished cage.
  • the growth state determination unit 46 determines the growth state of aquatic animals based on the biological information accumulated by the biological information storage unit 43 as follows. Various judgments may be made regarding the growth state. For example, the determination regarding the growth state includes, but is not limited to, determination of whether or not the aquatic animal is growing smoothly, and determination of whether or not there is a growth abnormality. For example, whether or not the aquatic animals have grown to a level suitable for shipping (that is, whether or not they meet the shipping standards) and whether or not the feeding conditions for the aquatic animals are appropriate, as described later. It may mean a judgment regarding.
  • the time-series biological information accumulated by the biological information storage unit 43 may be used, or only the biological information at one time point may be used.
  • the growth state determination unit 46 determines the growth state of the aquatic animal for each cage P.
  • the determination result of such a growth state may be transmitted by the transmission unit 19 to another device such as the terminal device 60.
  • the determination result is transmitted to the terminal device 60 or the like, the user can obtain information on the growth state of the aquatic animal through the terminal device 60 or the like.
  • the growth state determination unit 46 is in an abnormal state of growth of aquatic animals based on the biological information and the feeding information stored in the feeding information storage unit 26 (growth abnormality). It may be determined whether or not.
  • the determination by the growth state determination unit 46 may be performed based on, for example, the model information stored in the model information storage unit 25. That is, the growth state determination unit 46 can compare the growth process of aquatic animals obtained from time-series biological information with model information, and determine whether or not the growth is slow.
  • the growth state determination unit 46 may make a determination regarding the growth state based on the growth plan information stored in the growth plan information storage unit 27. That is, the growth state determination unit 46 may determine whether or not the size has reached the size expected as the growth state in the growth plan information.
  • the growth state determination unit 46 determines whether or not the growth state of the aquatic animal satisfies the shipping standard based on the biological information and the shipping standard information stored in the shipping standard information storage unit 28. You may. For example, when the fish length and sales time of aquatic animals are specified as the shipping standard, the growth state determination unit 46 reaches the fish length specified in the shipping standard for biological information at the sales time. If so, it can be determined that the product can be shipped.
  • the feeding instruction information generation unit 47 generates feeding instruction information regarding the feeding work to be performed on the aquatic animal based on the determination result regarding the growth state of the aquatic animal by the growth state determination unit 46.
  • the feeding instruction information includes, for example, information such as the time of feeding and the amount of feed.
  • the feeding instruction information may also include, for example, an identifier that identifies the feed to be fed.
  • the feeding instruction information generation unit 47 determines that the growth state of the aquatic animal is delayed (not progressing) in light of the growth plan by the growth state determination unit 46, it is determined. Generate feeding instruction information to promote the growth of aquatic animals more than usual. Specifically, for example, the time for feeding so that the amount of one feeding is increased more than usual (for example, the standard feeding amount stored in the storage unit 21 in advance) or the frequency of feeding is increased. Set.
  • the feeding instruction information is generated so that the growth of the aquatic animal is slower than usual. Specifically, for example, the time for feeding is set so that the amount of feeding at one time is reduced more than usual or the frequency of feeding is reduced. The generation of feeding instruction information is not limited to this.
  • the feeding instruction information is generated by the feeding instruction information generation unit 47
  • the feeding instruction information is stored in, for example, the storage unit 21.
  • the user can perform appropriate feeding according to the growing condition.
  • the feeding instruction information may be transmitted to the terminal device 60 by the transmission unit 19.
  • the user can receive information on feeding through the terminal device 60.
  • the terminal device 60 includes a terminal operation reception unit 61, a terminal output unit 62, a terminal transmission unit 64, a terminal reception unit 65, a terminal input unit 66, a terminal storage unit 71, and a terminal processing unit 73. Be prepared.
  • the terminal device 60 is, for example, an information terminal device that can be handled by a user who performs detection work at a place where detection work is performed (such as on a ship).
  • the terminal device 60 is, for example, a general tablet terminal and has a display device provided with a touch panel, but the terminal device 60 is not limited thereto.
  • the terminal device 2 is connectable to a network and is configured to be able to communicate with other devices connected to the network.
  • the terminal operation reception unit 61 receives information input by the user in response to the operation by the user.
  • the terminal output unit 62 has, for example, a terminal display unit 63 which is a display device.
  • the terminal output unit 62 outputs the information, for example, by displaying the information on the terminal display unit 63.
  • the information output method is not limited to this, and may be performed by outputting voice or the like from a speaker or the like. Further, the terminal output unit 62 may output by vibrating a vibration generating device or the like.
  • the terminal output unit 62 can read, for example, the information stored in the terminal storage unit 71 and output it.
  • the terminal display unit 63 can immediately display the image taken by the camera 81.
  • the terminal transmission unit 64 is usually realized by a wireless or wired communication means, but may be realized by a broadcasting means.
  • the terminal transmission unit 64 reads the transmission information configured by the terminal configuration unit 75 from the terminal storage unit 71 and the like, and transmits the transmission information.
  • the terminal transmission unit 64 transmits, for example, transmission information including information input from the camera unit 80.
  • the terminal receiving unit 65 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.
  • the terminal receiving unit 65 receives the information transmitted from the information processing device 10 and other devices via the network.
  • the terminal receiving unit 65 stores the received information in, for example, the terminal storage unit 71 so that the terminal processing unit 73 or the like can acquire it.
  • the terminal receiving unit 65 receives the notification information and the second notification information generated by the notification generation unit 36.
  • the terminal input unit 66 is an interface that is connected to an external device such as a camera unit 80 and controls the input of information output from the connected external device to the terminal device 60.
  • the terminal input unit 66 stores the input information in, for example, the terminal storage unit 71 so that the terminal processing unit 73 or the like can acquire it.
  • the terminal input unit 66 is composed of, for example, a connection terminal and a signal processing device conforming to a predetermined standard.
  • the terminal input unit 66 does not enable connection with an external device by wire, but may enable connection with an external device wirelessly. Further, the terminal input unit 66 may output information to an external device to enable bidirectional communication.
  • a non-volatile recording medium is suitable for the terminal storage unit 71, but a volatile recording medium can also be used.
  • Various information, programs, and the like are stored in the terminal storage unit 71. The process in which such information is stored does not matter.
  • the information may be stored in the terminal storage unit 71 via the recording medium, or the information transmitted via the communication line or the like may be stored in the terminal storage unit 71.
  • the information input via the input device may be stored in the terminal storage unit 71.
  • the terminal storage unit 71 has a position information storage unit 72.
  • the position information storage unit 72 stores position information indicating the position of the terminal device 60.
  • the position information is stored, for example, information acquired at any time by a position sensor (not shown) provided in the terminal device 60, but is not limited thereto.
  • a position sensor not shown
  • it may be the position information input by the user, or it may be the position information transmitted from an external device such as the camera unit 80.
  • the terminal processing unit 73 includes a terminal acquisition unit 74, a terminal configuration unit 75, and a terminal notification unit 76.
  • the terminal processing unit 73 can usually be realized from an MPU, a memory, or the like.
  • the processing procedure of the terminal processing unit 73 is usually realized by software, and the software is recorded in a recording medium such as ROM. However, it may be realized by hardware (dedicated circuit).
  • the terminal acquisition unit 74 acquires the information stored in the terminal storage unit 71 in order to execute the processing by the terminal processing unit 73.
  • the terminal acquisition unit 74 may acquire information input or transmitted to the terminal device 60.
  • the terminal configuration unit 75 configures transmission information in which information input from the camera unit 80, position information stored in the position information storage unit 72, and an identifier that identifies the camera 81 or the terminal device 60 are associated with each other. do.
  • the configured transmission information is transmitted to, for example, the information processing apparatus 10 by the terminal transmission unit 64.
  • the terminal notification unit 76 When the notification information or the like transmitted from the information processing apparatus 10 is received by the terminal receiving unit 65, the terminal notification unit 76 causes the terminal output unit 62 to output the information according to the notification information or the like. That is, the terminal notification unit 76 notifies the user of the detection status of aquatic animals based on the notification information acquired by the terminal reception unit 65.
  • the terminal notification unit 76 may notify the terminal output unit 62 by outputting voice, or may notify the terminal output unit 62 by outputting vibration. Further, the notification may be performed by using a plurality of means such as display on the terminal display unit 63, output of voice, and generation of vibration. By performing such a notification from the terminal output unit 62, the user can receive a notification regarding the detection status of aquatic animals and the like.
  • the camera unit 80 includes a camera 81, an environment sensor 84, and a camera output unit 85.
  • the camera 81 is, for example, a stereo camera.
  • the camera 81 is located at a position separated from each other, and includes a first image pickup unit 82 and a second image pickup unit 83, each of which has an image pickup element that receives light.
  • the camera 81 can capture a stereo image by capturing an image in each of the first imaging unit 82 and the second imaging unit 83.
  • the camera 81 is submerged in water and can take an underwater image of the cage P.
  • the camera 81 is not limited to a stereo camera. Further, the camera 81 may capture an image generated based on the result of transmitting and receiving ultrasonic waves, radio waves, or the like, for example.
  • the environment sensor 84 is attached to the jig 87 together with the camera 81, for example.
  • the environment sensor 84 is submerged in the water of the cage P, for example, to detect the water temperature, the concentration of oxygen, ammonia, nitrate, nitrite, carbon dioxide, and other matters related to water quality.
  • the camera output unit 85 is, for example, an interface that controls the output of information to an external device to which the camera unit 80 is connected.
  • the camera output unit 85 can output the image obtained by the camera 81 and the information detected by the environment sensor 84 to an external device.
  • the camera output unit 85 outputs these information to the terminal device 60 to which the camera unit 80 is connected.
  • the camera output unit 85 is composed of, for example, a connection terminal conforming to a predetermined standard, a signal processing device, or the like.
  • the camera output unit 85 does not enable connection with an external device by wire, but may enable connection with an external device wirelessly. Further, the camera output unit 85 may output information to an external device to enable bidirectional communication.
  • FIG. 4 is a perspective view showing an example of the camera 81.
  • FIG. 4 shows the posture of the camera 81 in a normal use state so that the top and bottom on the paper surface coincide with the top and bottom in the water, but the posture of the camera 81 is not limited to this. do not have.
  • the first image pickup unit 82 and the second image pickup unit 83 are vertically separated from each other by a predetermined distance. This makes it possible to measure the dimensions of aquatic animals in the cage P with relatively high accuracy based on the captured images.
  • the first image pickup unit 82 and the second image pickup unit 83 may be separated from each other in the horizontal direction (direction substantially perpendicular to the vertical direction).
  • the optical axes of both imaging units 82 and 83 are substantially parallel to each other, but the optical axis is not limited to this.
  • the camera 81 has a housing having a streamlined shape in which a cross section substantially perpendicular to the vertical direction forms a symmetrical wing shape having chords substantially parallel to the optical axes of the imaging units 82 and 83. is doing. That is, the housing of the camera 81 has a shape that is relatively less susceptible to drag against the flow parallel to the optical axes of the image pickup units 82 and 83.
  • FIG. 5 is a diagram illustrating a detection operation using the camera 81.
  • FIG. 5 schematically shows a view of the cage P from above.
  • the cage P is a region surrounded by, for example, a rectangular constituent member P1.
  • a large number of aquatic animals are swimming inside the cage P.
  • each aquatic animal orbits in the same direction on a circumferential path when viewed from above (indicated by a broken line arrow in the figure). Therefore, inside the cage P, a water flow flowing outward in the radial direction is generated from the circumferential path (indicated by a solid arrow in the figure).
  • the user puts the camera 81 outside the path around which the aquatic animals go around when performing the detection work for such a cage P. At this time, since there is a water flow flowing outward in the radial direction, the user can easily maintain the camera 81 in a posture in which the optical axes of the image pickup units 82 and 83 are substantially parallel in the radial direction. As a result, in the image taken by the camera 81, the appearance of each aquatic animal moving in the horizontal direction at a position close to the camera 81 is included. Therefore, the detection work can be performed with high accuracy.
  • FIG. 6 is a flowchart illustrating an example of the operation of the information processing apparatus 10.
  • the information processing apparatus 10 performs a detection operation related to the detection work performed by the user and a determination operation for determining the growth state of the cage P, for example, as follows.
  • Step S101 the processing unit 30 determines whether or not the work of one detection opportunity has been started. For example, when there is an information input from a user or the like instructing that it is a detection opportunity, or when the time is predetermined as a detection opportunity, the processing unit 30 starts the work of one detection opportunity. to decide. If it is determined that the work of one detection opportunity has started, the process proceeds to step S102, and if not, the process proceeds to step S103.
  • Step S102 The processing unit 30 performs an operation at the time of detection.
  • the operation at the time of detection will be described later.
  • Step S103 The processing unit 30 determines whether or not to start determining the growth state. For example, when there is an information input from a user or the like instructing to start the determination of the growth state, or when the time specified as the determination timing of the growth state arrives in advance, the processing unit 30 determines the growth state. Judge to start. If it is determined that the determination of the growth state is to be started, the process proceeds to step S104, and if not, the process returns to step S101.
  • Step S104 The growth state determination unit 46 sets 1 to the counter k.
  • Step S105 The growth state determination unit 46 determines whether or not there is a k-th cage P to be determined. If there is a k-th cage P to be determined, the process proceeds to step S106, and if not, the process returns to step S101.
  • Step S106 The growth state determination unit 46 performs an operation at the time of determination with respect to the kth cage P. The operation at the time of determination will be described later.
  • Step S107 The growth state determination unit 46 increments the counter k by 1 and returns to step S105.
  • FIG. 7 is a flowchart showing an example of the operation at the time of detection.
  • Step S111 The detection processing unit 31 determines whether or not the detection work for one cage P has been started. For example, when there is an information input from a user or the like instructing to start detection, or when reception of transmission information including an image or the like transmitted from the terminal device 60 is started, the detection processing unit 31 is one. It is determined that the detection work for the cage P has started. At this time, the detection processing unit 31 starts the detection work based on the cage identifier that identifies the cage P on which the detection operation is performed, which is included in the information input by the user or the transmission information from the terminal device 60, for example. It is possible to identify the cage P. If it is determined that the detection work for one cage P has started, the process proceeds to step S112, and if not, the process proceeds to step S115.
  • Step S112 The status information acquisition unit 41 acquires shooting status information.
  • Step S113 The detection processing unit 31 performs detection processing. The detection process will be described later.
  • the biological information acquisition unit 42 acquires the biological information obtained in the detection process.
  • the biological information storage unit 43 stores the biological information acquired by the biological information acquisition unit 42 in the biological information storage unit 24 in association with the photographing status information.
  • Step S115 The unfinished cage determination unit 44 determines whether or not there is an unfinished cage. If there is an unfinished cage, the process proceeds to step S116, and if not, the process proceeds to step S117.
  • Step S116 The unfinished cage information generation unit 44 generates unfinished cage information.
  • the transmission unit 19 transmits the generated unfinished cage information to the terminal device 60. This allows the user to know that there is an unfinished cage and that information.
  • Step S117 The detection processing unit 31 determines whether or not the detection work at one detection opportunity has been completed. For example, when there is an information input from a user or the like instructing to end the detection work, the detection processing unit 31 determines that the detection work has been completed. When there are no unfinished cages, the detection processing unit 31 may determine that the detection work has been completed. If it is determined that the detection work is completed, the process returns to the process of FIG. 6, and if not, the process returns to step S111.
  • FIG. 8 is a flowchart showing an example of the detection process.
  • Step S131 The detection processing unit 31 sets 1 in the counter i.
  • Step S132 The image acquisition unit 32 acquires an image taken by the camera 81.
  • Step S133 The detection unit 33 performs image recognition on the image and detects the fish body of the aquatic animal included in the image.
  • Step S134 The detection unit 33 determines whether or not a fish has been detected in the image. If it is detected, the process proceeds to step S135, and if not, the process proceeds to step S139.
  • the measuring unit 34 measures the fish body length of the detected fish body (i-th fish body). The measurement unit 34 records the measurement result in the storage unit 21.
  • Step S136 The detection processing unit 31 increments the counter i by 1.
  • Step S137 The notification determination unit 35 determines whether or not the second notification condition is satisfied based on the second notification condition. If it is determined that the second notification condition is satisfied, the process proceeds to step S138, and if not, the process proceeds to step S139.
  • Step S138 The notification generation unit 36 generates the second notification information.
  • the second notification information is transmitted to the terminal device 60 by the transmission unit 19. As a result, the terminal device 60 is notified based on the second notification information.
  • Step S139 The notification determination unit 35 determines whether or not the notification condition is satisfied based on the notification condition. If it is determined that the notification condition is satisfied, the process proceeds to step S140, and if not, the process proceeds to step S141.
  • Step S140 The notification generation unit 36 generates notification information.
  • the notification information is transmitted to the terminal device 60 by the transmission unit 19. As a result, the terminal device 60 is notified based on the notification information.
  • Step S141 The detection processing unit 31 determines whether or not the detection of the cage P has been completed. For example, when there is an information input from a user or the like instructing to end the detection of the cage P, the detection processing unit 31 determines that the detection of the cage P has been completed. In addition, when it is determined by the notification determination unit 35 that the notification condition is satisfied, or when a predetermined time has elapsed, it is automatically determined that the detection of the cage P has been completed by another trigger. You may. If it is determined that the detection of the cage P is completed, the process returns to the process of FIG. 7, and if not, the process returns to step S132.
  • FIG. 9 is a flowchart showing an example of the operation at the time of determination.
  • Step S151 The growth state determination unit 46 acquires time-series biological information about the kth cage P from the biological information storage unit 24.
  • Step S152 The growth state determination unit 46 acquires model information from the model information storage unit 25. Further, the growth state determination unit 46 acquires feeding information from the feeding information storage unit 26.
  • Step S153 The growth state determination unit 46 determines whether or not the aquatic animal is normally growing in the cage P. The determination can be made based on, for example, the acquired biological information, the model information, and the feeding information. The determination may be made based on the acquired biological information and the feeding information, or the determination may be made based on the biological information and the model information. If it is determined that the product is growing normally, the process proceeds to step S155, and if not, the process proceeds to step S154.
  • Step S154 The growth state determination unit 46 determines that the growth is abnormal.
  • Step S155 The growth state determination unit 46 acquires growth plan information from the growth plan information storage unit 27.
  • Step S156 The growth state determination unit 46 determines whether or not the growth state of the aquatic animal is progressing in light of the growth plan based on the growth plan information and the biological information. Then, the feeding instruction information generation unit 47 generates feeding instruction information as described above based on the determination result of the growth state determination unit 46.
  • Step S157 The growth state determination unit 46 acquires the shipping standard information stored in the shipping standard information storage unit 28.
  • Step S158 The growth state determination unit 46 determines whether or not the growth state of the aquatic animal satisfies the shipping standard based on the biological information and the shipping standard information. If the shipping standard is satisfied, the process proceeds to step S158, and if not, the process returns to the process of FIG.
  • Step S159 The growth state determination unit 46 determines that the aquatic animal of the kth cage P can be shipped. After that, the process returns to FIG.
  • FIG. 10 is a diagram illustrating an example of the operation of the biological information storage unit 43.
  • the transmission information transmitted from the terminal device 60 to the information processing device 10 does not have to include the cage identifier.
  • the transmission information includes position information indicating the position of the terminal device 60 that performs the detection work, and the fish cage identification process for specifying the fish cage P for which the detection work was performed based on the position information in the information processing device 10 is performed. It may be done.
  • each row (each record) of the table represented by the reference numeral D1 is an example of transmission information. That is, the transmission information corresponds to, for example, the shooting date and time, the position information, the detection value detected by the environment sensor 84 (for example, oxygen concentration, pH, and water temperature), and the image identifier that identifies the shot image. It is the attached information.
  • the transmission information corresponds to, for example, the shooting date and time, the position information, the detection value detected by the environment sensor 84 (for example, oxygen concentration, pH, and water temperature), and the image identifier that identifies the shot image. It is the attached information.
  • the table represented by the reference numeral D2 is the cage information in which the cage identifier and the position information of the cage P are associated with each of the plurality of cages P to be managed.
  • Such cage information may be stored in the storage unit 21 in advance, or may be transmitted from the information input device 90 or the like to the information processing device 10.
  • the processing unit 30 When such transmission information is transmitted from the terminal device 60, the processing unit 30 performs a cage identification process using the cage information indicated by the reference numeral D2. That is, in the cage identification process, the processing unit 30 can acquire the cage identifier of the cage corresponding to the position information included in the transmission information from the cage information and associate it with the transmission information. Further, by performing the detection process on the image, it is possible to obtain information such as the fish body length of the aquatic animal and associate it with the information included in the transmission information.
  • Each row (each record) of the table indicated by the reference numeral D3 is an example of biological information and shooting status information associated with the biological information. That is, for example, the average body length, which is biological information, the shooting date and time, which is shooting time information, the fish cage identifier, the fish species, the weather, the water temperature, the number of growing days, and whether or not the water quality is normal, respectively.
  • the shooting status information of the above is associated with each other and stored in the biological information storage unit 24.
  • the fish species, the weather, and the number of growing days are associated with the cage identifier based on the information transmitted from the information input device 90, but the present invention is not limited to this.
  • the information indicating whether or not the water quality is normal is the information generated by the processing unit 30 based on the measured value regarding the water quality included in the transmission information transmitted from the terminal device 60, but is limited to this. do not have.
  • various information for example, feeding information such as daily feeding amount may be associated with biological information.
  • time-series biological information is accumulated for each cage P.
  • FIG. 11 is a diagram showing an example of time-series biological information stored in the biological information storage unit 24.
  • FIG. 11 shows an example of biological information about the cage P whose cage identifier is "AA003".
  • the biological information storage unit 43 stores the biological information in association with the shooting time information (for example, the shooting date and time) and the cage identifier. Therefore, it is possible to extract time-series biological information by using the cage identifier as a key for each cage P. From the time-series biological information, the growth process of aquatic organisms can be obtained for each cage P. By comparing such time-series biological information with, for example, model information, various determinations and evaluations can be made, such as whether or not the growth status of aquatic animals is appropriate.
  • FIG. 12 is a diagram showing an example of shipping standard information stored in the shipping standard information storage unit 28.
  • the shipping standard information includes, for example, a shipping destination, a desired delivery date (an example of information for specifying a shipping time), and a fish body length (an example of a shipping standard) as a standard for shipping. It is associated with an identifier. In addition to these information, information on fish species, order details, that is, order identifiers that specify shipping conditions, etc. may be associated. Based on such shipping standard information and biological information, it is possible to determine whether or not the aquatic animal has grown to the extent that it satisfies the shipping standard for each cage P.
  • FIG. 13 is a table illustrating the operation of the feeding instruction information generation unit 47.
  • FIG. 13 shows in tabular form an example of information that determines the standard feeding amount used for generating feeding instruction information.
  • the daily feeding amount to be given to a predetermined number of aquatic animals grown in the cage P is shown.
  • the amount of feed is determined according to the body weight of the aquatic animal and the water temperature.
  • the feeding instruction information generation unit 47 can obtain, for example, the standard feeding amount based on the information for determining the standard feeding amount thus determined, the detected biological information, the water temperature, and the like. Then, when the growth state of the aquatic animal is delayed or advanced in light of the growth plan, the feeding instruction information generation unit 47 instructs the feeding instruction to feed the feeding amount increased or decreased from the standard feeding amount. Information can be generated.
  • the processing unit 30 generates information for determining the standard feeding amount based on the time-series biological information including the photographing status information and the feeding information, or generates preset information. It may be corrected. Further, the processing unit 30 may generate model information or correct preset model information based on time-series biological information including shooting status information. Such information for determining the standard feeding amount and model information can be generated or corrected for each fish species, for each fish cage P, or for each area where the cage P is located. The generation of such information and model information for determining the standard feeding amount can be specifically performed, for example, by analyzing biological information or the like by a statistical method. Further, the correction of the information for determining the standard feeding amount and the model information is performed, for example, by calculating the correction value for the existing information based on the comparison result between the obtained biological information and the existing information. Can be done.
  • FIG. 14 is a flowchart showing an example of an operation related to correction of model information by the processing unit 30.
  • the processing unit 30 can correct the model information as follows, for example.
  • Step S101 The processing unit 30 acquires time-series biological information about a predetermined fish species from the biological information storage unit 24.
  • Step S102 The processing unit 30 acquires the model information stored in the model information storage unit 25.
  • the processing unit 30 generates a correction value by comparing the acquired time-series biological information with the model information. Specifically, for example, for a specific fish species, the average value of biological information such as fish body length for a large number of fish cages P, and the average value of biological information such as fish body length at different growth opportunities with similar growth days. However, if it deviates from the average value of the fish body length specified by the model information by a predetermined threshold or more, a predetermined value is generated as a correction value. The generation of the correction value is not limited to this.
  • Step S104 The processing unit 30 updates the model information using the generated correction value. Further, the updated model information is stored in the model information storage unit 25 and used in the subsequent processing.
  • such information for determining the standard feeding amount and model information may be generated by using, for example, the above-mentioned machine learning method.
  • a learning device configured with shooting status information as input information and biological information as output information can be used as model information.
  • a learning device configured with biological information including photographing status information as input information and feeding information corresponding to the biological information as output information can be used as information for outputting the feeding amount.
  • the feeding instruction information generation unit 47 can generate feeding instruction information that specifies a desirable feeding amount by inputting biological information including photographing status information into the learning device.
  • model information may be created. For example, it is possible to evaluate the relationship between the size of a fish, environmental data such as water temperature, and daily feeding amount, and create a relational expression and a correspondence table. Thereby, based on the measurement result regarding the size of the aquatic animal in real time and the acquired relational expression, it is possible to notify the appropriate s feeding amount in real time.
  • the user may check the image used for the detection, and exclude / modify the image that is considered to be unsuitable for the configuration of the learning device.
  • Another physiological characteristic of fish is that the growth rate changes according to age and maturity. The tendency of the growth curve depends on the seedlings and environmental conditions, but since the overall tendency is the same, the feature amount of the growth curve is extracted by using the actual data of the growth curve obtained by measuring the fish body length etc. as input information. You may. In addition, by correcting the growth curve due to the results of existing biophysiology with model information obtained by utilizing time-series biological information, seedling characteristics and environmental characteristics peculiar to the application destination of the aquatic animal detection system 1 can be obtained. You may create a growth model that takes this into consideration. By calculating the growth curve of the fish body in this way, it is possible to recommend a guideline time when it is suitable to perform the next detection work.
  • the conventional aquatic animal detection device it may not be easy to perform the work involving the detection of aquatic animals in the water. That is, it has been difficult for the user who performs the detection work to know on board the ship whether or not the detection work can be performed so that the detection result can be properly obtained.
  • the cameras used for the detection work are generally relatively large, and it is necessary to prepare large-scale equipment for the detection work itself.
  • the user can receive a notification about the detection work when a predetermined notification condition is satisfied. Therefore, since the user can quickly know whether or not the detection work for obtaining the detection result appropriately can be performed, the detection work for aquatic animals can be easily performed.
  • the notification may be performed, for example, by displaying the information on the terminal device 60. As a result, the user can receive the notification while viewing the image taken by the camera 81. Further, the notification may be performed, for example, by outputting voice or vibration from the terminal device 60. As a result, the user can receive the notification even if he / she is not watching the screen of the terminal device 60.
  • notification is performed by outputting voice, vibration, light, or the like from a device that operates in cooperation with the terminal device 60 (for example, a device such as a camera unit 80 or a speaker that can communicate with the terminal device 60). You may.
  • the camera 81 used for the detection work can be a relatively small one. Further, the camera unit 80 can be miniaturized to such an extent that the user can grasp it by using the jig 87. Since the camera unit 80 and the terminal device 60 can be connected to perform the detection work on a ship or the like, the detection work of aquatic organisms can be easily performed. Further, since the user can be notified through such a terminal device 60, the user can be effectively notified. Since the camera 81 is small, it is difficult for aquatic animals to be alert and it is possible to take an effective picture. It also reduces the chance of damaging aquatic fish.
  • processing in this embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded on a recording medium such as a CD-ROM and disseminated.
  • the software that realizes the aquatic animal detection device 10D in the present embodiment can be the following program.
  • this program has an image acquisition step of acquiring an image taken by a camera on a computer, a detection step of detecting an aquatic animal shown in an image taken by a camera, and a detection status of aquatic animals by the detection step. It is a program that executes a notification determination step for determining whether or not the notification condition is satisfied and a notification generation step for generating notification information when it is determined by the notification determination step that the notification condition is satisfied.
  • the present invention is not limited to this.
  • Some of the functional blocks constituting the information processing device 10 may be provided in other devices constituting the aquatic animal detection system 1, and some of the functional blocks constituting the terminal device 60 may be provided in the aquatic animal detection system 1. It may be provided in another device constituting the system 1.
  • FIG. 15 is a block diagram of the aquatic animal detection system 101 according to a modification of the first embodiment.
  • FIG. 16 is a block diagram of the information processing apparatus 110.
  • the aquatic animal detection system 101 has an information processing device 110 and a terminal device 160 having different configurations from the information processing device 10 and the terminal device 60 of the first embodiment, respectively.
  • the terminal device 160 has a terminal storage unit 171 and a terminal processing unit 173.
  • the terminal storage unit is different from the terminal storage unit 71 in the first embodiment in that it further has a notification condition storage unit 22 and a second notification condition storage unit 23.
  • the terminal processing unit 173 is different from the terminal processing unit 73 in the first embodiment in that it has a detection processing unit 31. That is, the terminal device 160 has an aquatic animal detection device 160D configured in the same manner as the aquatic organism detection device 10D provided in the information processing device 10 in the first embodiment, as compared with the terminal device 60 in the first embodiment. It can be said that they differ in that they have.
  • the information processing device 110 has a storage unit 121 and a processing unit 130.
  • the storage unit 121 is different from the storage unit 21 in the first embodiment in that it does not have the notification condition storage unit 22 and the second notification condition storage unit 23.
  • the processing unit 130 is different from the processing unit 30 in the first embodiment in that it does not have the detection processing unit 31.
  • the aquatic animal detection system 101 configured in this way, by allowing the terminal device 160 and the information processing device 110 to appropriately transmit and receive information, the detection is roughly performed in the same manner as in the first embodiment. It is possible to perform time operation and judgment time operation.
  • the terminal device 160 that can be used at the hand of the user who performs the detection work near the cage P functions as the aquatic organism detection device 160D. That is, during the aquatic animal detection operation, the terminal device 160 detects the aquatic animal and outputs the notification information without transmitting the image from the terminal device 160 to the information processing device 110. At this time, it can be said that the terminal notification unit 76 of the terminal device 160 functions as a notification output unit that outputs notification information. For example, the notification information generated by the notification generation unit 36 is output to the terminal display unit 63 that displays the image captured by the camera 81.
  • the determination operation may be executed when the terminal device 160 and the information processing device 110 can communicate with each other.
  • the aquatic animal detection system 201 is configured so that the user can perform the detection work even in a remote environment by using the camera unit 280 installed in the cage P.
  • FIG. 17 is a schematic diagram of the aquatic animal detection system 201 according to the second embodiment of the present invention.
  • FIG. 18 is a block diagram of the aquatic animal detection system 201.
  • the aquatic animal detection system 201 includes an information processing device 10, a terminal device 60, a camera unit 280, and an information input device 90. Also in the present embodiment, the information processing device 10 also functions as the aquatic animal detection device 10D, but the present invention is not limited to this.
  • the information processing device 10, the terminal device 60, and the information input device 90 are configured in the same manner as in the first embodiment.
  • the camera unit 280 itself is configured to be connectable to a network, and is configured to be able to communicate with, for example, the information processing device 10. That is, the camera unit 280 has a camera 281, a camera storage unit 282, a camera processing unit 283, a camera configuration unit 284, a camera transmission unit 285, a camera reception unit 286, and an environment sensor 84. ..
  • the camera 281 is a stereo camera having a first image pickup unit 82 and a second image pickup unit 83, similarly to the camera 81 of the first embodiment. As will be described later, the camera 281 has a housing having a shape different from that of the camera 81, but is not limited to this. That is, the camera 81 of the first embodiment may also be used for the camera unit 280.
  • the camera storage unit 282 is realized by a non-volatile recording medium, it can also be realized by a volatile recording medium.
  • the camera storage unit 282 stores, for example, an image taken by the camera 281 and a measured value of the environment sensor 84 for transmission to an external device, but the present invention is not limited to this.
  • the camera processing unit 283 controls the operation of the camera unit 280 and performs processing in cooperation with the information processing device 10. Coordination with devices connected via a network, such as the information processing device 10 and the terminal device 60, can be performed by transmitting a command to each device or receiving information from each device. For example, when the camera receiving unit 286 receives the shooting control information transmitted from the information processing device 10 or the like, the camera processing unit 283 controls each unit of the camera unit 280 based on the shooting control information.
  • the shooting control information is, for example, a shooting start or stop instruction, a camera 281 control instruction, a transmission information transmission instruction, a status information transmission instruction indicating the state of the camera unit 280, and the like, but the present invention is not limited thereto.
  • the camera processing unit 283 can usually be realized from an MPU, a memory, or the like.
  • the processing procedure of the camera processing unit 283 is usually realized by software, and the software is recorded in a recording medium such as ROM. However, it may be realized by hardware (dedicated circuit).
  • the camera configuration unit 284 is provided in the camera processing unit 283.
  • the camera configuration unit 284 configures the transmission information transmitted from the camera unit 280 to the information processing apparatus 10 in association with an identifier that identifies the camera unit 280 or each unit thereof.
  • the transmission information includes, but is not limited to, an image taken by the camera 281, a measured value of the environment sensor 84, and the like.
  • the position information acquired by the environment sensor 84 using GPS or the like may be included in the transmission information.
  • the camera transmitting unit 285 and the camera receiving unit 286 connect the camera unit 280 to the network and perform communication with other devices connected to the network.
  • the camera transmitting unit 285 and the camera receiving unit 286 may be configured to perform wireless communication using, for example, wireless LAN or data communication of a mobile phone, or may be configured to perform various types of wired communication. You may be.
  • the camera transmission unit 285 transmits information to other devices.
  • the camera transmission unit 285 transmits, for example, the information stored in the camera storage unit 282 or the information handed over from the camera processing unit 283.
  • the camera transmission unit 285 transmits the transmission information configured by the camera configuration unit 284 to the information processing device 10 and the like.
  • the camera receiving unit 286 receives information transmitted from another device.
  • the camera receiving unit 286 passes the received information to, for example, the processing performed by the camera processing unit 283.
  • the camera receiving unit 286 receives the shooting control information transmitted from the information processing device 10 or the like.
  • the camera unit 280 itself is configured to be able to transmit transmission information including an image via a network in this way, so that the user can use the terminal, for example, as follows.
  • the device 60 can be used to detect the cage P from a remote location. Therefore, the detection work can be easily performed.
  • the user uses the terminal device 60 to transmit a shooting instruction or the like to the information processing device 10.
  • a shooting instruction or the like an identifier that identifies the camera unit 80 may be specified, or the cage identifier of the cage P may be specified.
  • a group of a plurality of cages P to be detected at one detection opportunity may be designated in advance, and a shooting instruction may be given using an identifier or the like that designates the group.
  • the information processing device 10 transmits shooting control information to the camera unit 80. Then, the camera unit 80 transmits the transmission information including the image to the information processing apparatus 10.
  • the information processing device 10 receives the transmission information transmitted from the camera unit 80 and performs an operation at the time of detection. Further, the result is transmitted to the terminal device 60. If the notification condition is satisfied during the detection operation, the information processing device 10 outputs the notification information to the terminal device 60 to notify the user, as in the first embodiment. You may do so. As a result, the user can easily perform the detection work as in the first embodiment.
  • FIG. 19 is a perspective view showing a schematic configuration of the camera unit 280.
  • the camera unit 280 has a jig 287 to which the camera 281 is attached.
  • the jig 287 has an arm portion 88 for submerging and holding the camera 281 in water, and a hook 89 hooked on a constituent member P1 constituting the cage P. That is, the camera unit 280 can hold the camera 281 in a predetermined position by hooking the hook 89 on a part of the constituent member P1 (for example, the upper end edge of the net that partitions the cage P).
  • the shape and configuration of the jig 287 are not limited to this.
  • the camera unit 280 may be configured so that it can be attached to the constituent member P1 by using a wire or the like or by a method such as a spiral stopper.
  • the housing of the camera 281 has a flat shape in which the dimensions parallel to the optical axes of the image pickup units 82 and 83 are relatively small. Therefore, the camera 281 can be placed in the water so that the housing of the camera 281 is aligned with the constituent member P1, and the position of the camera 281 can be stably held.
  • FIG. 20 is a perspective view showing an arrangement example of the camera 281.
  • the back surface of the housing of the camera 281 (the surface opposite to the surface facing the direction in which the photographing units 82 and 83 take images) is, for example, the inner surface of the constituent member P1 which is a net. It can be arranged along. As described above, in the cage P, the movement of aquatic animals creates a radial flow of water, and the water flow pushes the camera 281 toward the component P1. Therefore, the position of the camera 281 is stable.
  • the camera 281 can be fixed in water without diving work. Further, since a plurality of camera units 280 installed for each cage can be integratedly managed, monitoring work of each cage P can be easily performed even if the number of cages P increases.
  • the aquatic animal detection system 301 is configured so that the feeding operation to the cage P can be automatically performed or the feeding operation can be performed by remote control by using the feeding device 600 installed in the cage P. Is.
  • FIG. 21 is a schematic diagram of the aquatic animal detection system 301 according to the third embodiment of the present invention.
  • FIG. 22 is a block diagram of the aquatic animal detection system 301.
  • the aquatic animal detection system 301 includes an information processing device 10, a terminal device 60, a camera unit 280, and an information input device 90, as in the second embodiment. Also in the present embodiment, the information processing device 10 also functions as the aquatic animal detection device 10D, but the present invention is not limited to this.
  • the aquatic animal detection system 301 further includes a feeding device 600 capable of communicating with, for example, an information processing device 10 via a network.
  • the feeding device 600 has the following components and automatically supplies feed to the cage P.
  • the feeding device 600 includes a measuring unit (not shown) for measuring the feed, a spraying mechanism (not shown), and a driving unit (not shown) for driving the spraying mechanism and the like. ) Etc. Further, the feeding device 600 has a feeding storage unit 601, a feeding processing unit 603, a feeding transmitting unit 605, and a feeding receiving unit 606. The feeding device 600 is arranged above the cage P, for example.
  • the measuring unit is a scale that measures the feed taken out from the feed tank 610.
  • the measuring unit can weigh a predetermined amount of feed and take it out from the feed tank 610 according to the control by the feed processing unit 603.
  • the spraying mechanism supplies the feed weighed by the measuring unit to the cage P.
  • the spraying mechanism has, for example, a rotatable arm member, and the feed can be evenly sprayed on the cage P by sprinkling the feed from the arm member while rotating the arm member by the drive unit which is an electric motor. It is configured in.
  • the supply unit for supplying the feed to the cage P is not limited to such a spraying mechanism, and known means can be widely used.
  • the feeding condition includes, for example, a condition relating to the feeding timing and a condition relating to the feeding amount.
  • a non-volatile recording medium is suitable for the feeding storage unit 601, but a volatile recording medium can also be used.
  • the feeding instruction information transmitted from the information processing apparatus 10 is stored in the feeding storage unit 601 as the feeding condition (the feeding condition is set).
  • the process of storing the feeding conditions in the feeding storage unit 601 is not limited to this, and the user may set the feeding conditions based on the feeding instruction information.
  • the feeding condition may be stored in the feeding storage unit 601 via the recording medium, or the feeding condition transmitted from the terminal device 60 or the like may be stored in the feeding storage unit 601.
  • the feeding conditions input via the input device may be stored in the feeding storage unit 601.
  • the feeding processing unit 603 can usually be realized from an MPU, a memory, or the like.
  • the processing procedure of the feeding processing unit 603 is usually realized by software, and the software is recorded in a recording medium such as ROM. However, it may be realized by hardware (dedicated circuit).
  • the feed processing unit 603 supplies feed to the cage P based on the feeding conditions stored in the feed storage unit 601.
  • the feeding processing unit 603 records the feeding information (log; for example, information such as the feeding time and the feeding amount) when the feeding is actually performed.
  • the feeding processing unit 603 can transmit the recorded feeding information and the like to the information processing device 10 and the like by the feeding transmitting unit 605.
  • the feeding transmitting unit 605 and the feeding receiving unit 606 connect the feeding device 600 to the network and communicate with other devices connected to the network.
  • the feeding transmitting unit 605 and the feeding receiving unit 606 may be configured to perform wireless communication using, for example, wireless LAN or data communication of a mobile phone, or may be configured to perform various types of wired communication. You may be.
  • the feeding transmission unit 605 transmits information to other devices.
  • the feeding transmission unit 605 transmits, for example, the information stored in the feeding storage unit 601 or the information handed over from the feeding processing unit 603.
  • the feeding transmission unit 605 transmits the feeding information indicating the feeding amount, the date and time, etc. of the feeding to the information processing device 10 or the like in association with the cage identifier of the cage P, the identifier that identifies the feeding device 600, or the like. do.
  • the feeding receiving unit 606 receives the information transmitted from other devices.
  • the feeding receiving unit 606 stores the received information in, for example, the feeding storage unit 601 or passes it to the processing performed by the feeding processing unit 603.
  • the feeding receiving unit 606 receives the feeding instruction information transmitted from the information processing apparatus 10 or the like.
  • the aquatic animal detection system 301 is provided with the feeding device 600 connected to the network in this way, the feeding work can be automated or remotely executed. Further, the feeding device 600 feeds based on the feeding instruction information transmitted from the information processing device 10. Therefore, the information processing device 10 generates feeding instruction information based on the growth state of the aquatic animal determined through the detection operation in the cage P, and the feeding device 600 is made to execute the feeding operation based on the generated feeding instruction information. be able to. Therefore, in the cage P, it becomes possible to accurately feed while detecting the growing state of aquatic animals.
  • the feeding amount according to the average fish body size in real time may be determined, and the amount of food to be fed in real time may be transmitted as feeding instruction information. Further, it may be instructed to automatically stop feeding when the feeding amount reaches a predetermined threshold value.
  • sufficient food is given to small fish in the cage P based on the fish activity index and fish size that can be measured in real time. You may decide whether or not you have it and adjust the feeding time and amount.
  • the total amount of satiety feeding may be calculated by feeding until the entire cage P is in a satiety state.
  • the user may use the terminal device 60 to transmit a feeding instruction or the like to the information processing device 10, and the information processing device 10 may be able to transmit the feeding instruction information to the feeding device 600 accordingly. ..
  • the feeding instruction an identifier specifying the feeding device 600 may be specified, or the cage identifier of the cage P may be specified.
  • the feeding instruction may be transmitted from the terminal device 60 to the feeding device 600 via the network.
  • the feeding device 600 may be configured to perform the feeding operation based on the received information.
  • the feeding operation by the feeding device 600 and the shooting by the camera 281 may be performed in conjunction with each other. It is difficult to adjust the shooting range by moving the camera 281 in the water, but it is detected per unit time by guiding the aquatic animals by feeding operation so that the aquatic animals that eat the food are photographed by the camera 281. The possible number of individuals can be increased. Further, by guiding the entire aquatic animal to fit in the image in relation to the shooting range of the camera 281, more accurate detection can be performed.
  • a processing device is used.
  • the processing device is used with a target device having a camera to acquire images of aquatic animals being raised.
  • the processing device has a function of supplying electric energy to the target device.
  • the processing device has a function of receiving an image taken by a camera and information based on the image, and outputting information based on the received information.
  • the processing device is detachably attached to the target device.
  • the processing device and the target device are combined so as to be able to function as a camera unit in the above-described embodiment.
  • the processing device may be referred to as a core module.
  • the configurations of the processing device, the target device, and the like configured in this way, and the aquatic animal detection system using these will be described.
  • FIG. 23 is a diagram showing a hardware configuration of the information collecting device 580 according to the fourth embodiment of the present invention.
  • FIG. 24 is a perspective view showing the hardware configuration of the processing device 510.
  • the information collecting device 580 includes a target device 580b and a processing device 510.
  • the target device 580b of the information collecting device 580 has a camera (an example of an image acquisition unit) 581 and a jig 587 to which the camera 581 is attached, similarly to the camera unit 280 in the above-described embodiment. ..
  • the jig 587 has an arm portion 88 for submerging and holding the camera 581 in water, and a hook 89 hooked on a part of the cage P or the like.
  • the shape and configuration of the jig 587 are not limited to this.
  • the target device 580b may be used by being attached to a float on water or the like, or being attached to or incorporated in another structure.
  • a feeding device 600 provided with an image acquisition unit such as a camera 581 may be used as the target device 580b.
  • the camera 581 is a stereo camera having two image pickup units 82 and 83.
  • the camera 581 acquires an image of an aquatic animal being raised in a cage P or the like.
  • the form of the camera 581 is not limited to this, and the camera 581 may have one imaging unit.
  • an image acquisition unit capable of acquiring an image by various methods can be used. That is, the image acquisition unit is not necessarily limited to one that receives visible light and acquires an image, and is capable of constructing an image corresponding to a predetermined target range by using, for example, sound waves, radio waves, invisible light, or the like. May be used.
  • the image acquisition unit may be capable of acquiring an image by so-called sonar.
  • the image acquisition unit may be configured by combining a plurality of cameras 581, sensors, and the like.
  • the upper portion of the target device 580b is a mounting portion 580d to which a processing device 510 having a box-shaped outer shape can be mounted as described later.
  • the mounting portion 580d has a recess 580f into which the processing device 510 is fitted.
  • the upper part of the recess 580f is covered with a cover. That is, it can be said that the processing device 510 is housed inside the target device 580b in a state of being mounted on the mounting portion 580d.
  • the information collecting device 580 is configured so that an image of an aquatic animal or the like can be acquired by the camera 581 in a state where the processing device 510 is attached to the target device 580b. In this respect, it can be said that the information collecting device 580 functions in the same manner as the above-mentioned camera unit 280.
  • the usage state of the processing device 510 in the state of being attached to the target device 580b and the operation mode of the processing device 510 may be referred to as an information acquisition mode.
  • the processing apparatus 510 is configured such that each part is housed inside the cartridge housing 510f.
  • the cartridge housing 510f has, for example, a substantially rectangular parallelepiped shape. It may be said that the cartridge housing 510f has a box shape.
  • a finger hook portion 510g is formed on the upper portion of the cartridge housing 510f.
  • the finger hook portion 510g is a portion slightly recessed from the outer peripheral surface of the cartridge housing 510f, and is configured so that the user can hook a finger.
  • a groove portion 510s formed along the insertion direction of the cartridge housing 510f into the recess 580f is formed on the side surface of the cartridge housing 510f.
  • the cartridge housing 510f By inserting the cartridge housing 510f into the recess 580f so that the fitting portion (not shown) formed in the recess 580f fits into the groove 510s, the cartridge housing is surely inserted into the recess 580f so as not to cause misalignment. 510f can be attached.
  • a core connection portion 510c is provided on the bottom surface of the cartridge housing 510f.
  • the core connection portion 510c can be connected to the camera connection portion 580c provided inside the recess 580f of the target device 580b.
  • the core connection portion 510c and the camera connection portion 580c are composed of, for example, a connector including a terminal for power supply and a terminal for communication, and a driver thereof.
  • the processing device 510 can be removed from the target device 580b and used. In this state, the processing device 510 can output information to other devices connected via an external network.
  • the usage state and the operation mode of the information processing apparatus 510 capable of outputting information in this way may be referred to as an output mode in comparison with the information acquisition mode.
  • the processing device 510 can be attached to the charging device 590 when it is removed from the target device 580b.
  • the charging device 590 is configured so that, for example, two processing devices 510 can be attached at the same time, but the number of the processing devices 510 that can be attached is not limited to two.
  • the charging device 590 has a recessed insertion portion 590b and a charging terminal 590c provided inside the insertion portion 590b.
  • the charging terminal 590c is connected to the core connection portion 510c of the processing device 510 attached to the insertion portion 590b. With the charging terminal 590c connected to the core connection portion 510c, electric energy is supplied from the charging device 590 to the processing device 510.
  • the processing device 510 is configured to be able to perform various processing operations including output of information and a charging operation as described later by using the supplied electric energy.
  • the charging device 590 is configured so that it can be used by being connected to, for example, a commercial power source, but the charging device 590 is not limited to this.
  • a fitting portion 590s is formed inside the insertion portion 590b.
  • the fitting portion 590s is a portion formed along the insertion direction of the cartridge housing 510f.
  • a cable for power supply may be directly connected to the cartridge housing 510f.
  • a communication path between the external device and the processing device 510 may be configured via the charging device 590.
  • electric power may be supplied to the processing device 510 by a known non-contact power feeding method, or electric power may be supplied from the processing device 510.
  • the processing device 510 and the target device 580b may be communicably connectable, or the processing device 510 and the charging device 590 or the like may be communicably connectable.
  • FIG. 25 is a schematic diagram of the aquatic animal detection system 501 using the information collecting device 580.
  • FIG. 26 is a block diagram of the aquatic animal detection system 501.
  • the aquatic animal detection system 501 uses the information collecting device 580 installed in the aquatic animal P, similarly to the aquatic animal detection system 201 in the second embodiment, even if the user is not near the aquatic animal P. It is configured to be able to detect aquatic animals.
  • the camera unit 201 is communicably connected to the information processing device 10 or the like via a network so that immediate detection work can be performed in a remote environment. ..
  • the processing device 510 the processing device 510.
  • the processing device 510 autonomously acquires information while the information collecting device 580 functions in the information acquisition mode, and the processing device 510 outputs the information acquired by the processing device 510 from the information collecting device 580. It can be done in the output mode in the removed state. That is, in the present embodiment, the image is acquired in the information acquisition mode in the farm (fish cage P), and the information is output by the processing device 510 in the output mode on the ground or on board.
  • processing device 510 may output information even while the processing device 510 is attached to the information output device 580. Further, the information output from the processing device 510 may be performed by wired communication.
  • the aquatic animal detection system 501 includes an information processing device 10, a terminal device 60, an information collecting device 580, and an information input device 90. Also in the present embodiment, the information processing device 10 also functions as the aquatic animal detection device 10D, but the present invention is not limited to this.
  • the information processing device 10, the terminal device 60, and the information input device 90 are configured in the same manner as in the first embodiment.
  • the information collecting device 580 is used by attaching the processing device 510 to the target device 580b in the information acquisition mode.
  • the aquatic animal detection system 501 is composed of an information processing device 10, a terminal device 60, an information input device 90, and an information collecting device 580.
  • the processing device 510 can communicate with other devices of the aquatic animal detection system 501 in the output mode. That is, in this case, it can be said that the aquatic animal detection system 501 is composed of an information processing device 10, a terminal device 60, an information input device 90, and a processing device 510.
  • the target device 580b includes a camera 581, a camera connection unit 580c, a camera storage unit 582, a camera processing unit (an example of the first processing unit) 583, a camera configuration unit 284, and an environment sensor 84. ..
  • the camera storage unit 582 is realized by a non-volatile recording medium, it can also be realized by a volatile recording medium.
  • the camera storage unit 582 stores, for example, an image taken by the camera 581, a measured value of the environment sensor 84, and the like for transmission to the processing device 510, but the present invention is not limited to this.
  • the camera processing unit 583 can usually be realized from an MPU, a memory, or the like.
  • the processing procedure of the camera processing unit 583 is usually realized by software, and the software is recorded in a recording medium such as ROM. However, it may be realized by hardware (dedicated circuit).
  • the camera processing unit 583 acquires (photographs) an image using the camera 581 in the information acquisition mode, transmits information to the processing device 510, and the like.
  • the camera processing unit 583 performs processing (sometimes referred to as first processing) using the camera configuration unit 584 as follows.
  • the camera configuration unit 584 is provided in the camera processing unit 583.
  • the camera component unit 584 configures transmission information to be transmitted to the processing device 510.
  • the transmission information includes, for example, an image taken by the camera 581, a position identifier acquired by the environment sensor 84 using GPS or the like, a device identifier that identifies the target device 580b, and the like.
  • the camera configuration unit 584 configures transmission information by associating, for example, an image taken by the camera 581 with a device identifier and a position identifier (an example of the first process). That is, the first process may be expressed as a process of acquiring transmission information based on the image acquired by the camera 581.
  • the device identifier and the position identifier may not be included in the transmission information. It can be said that the position identifier is information indicating the position where the image was acquired. That is, the position identifier may be information acquired by GPS or the like, or may be information for specifying a cage, position information associated with information for identifying a cage, or the like.
  • the processing device 510 includes a core control unit 511, a power supply unit 516, a core transmission unit 518, and a core reception unit 519, in addition to the core connection unit 510c.
  • the power supply unit 516 includes a secondary battery 517 such as a lithium ion battery.
  • the power supply unit 516 controls the charging and discharging of the secondary battery 517.
  • the power supply unit 516 supplies the electric energy stored in the secondary battery 517 to each part of the processing device 510 or supplies the connected target device 580b to make the information collecting device 580 function.
  • the core transmission unit 518 connects the processing device 510 to the network and communicates with other devices connected to the network.
  • the core transmission unit 518 may be configured to perform wireless communication using, for example, wireless LAN or data communication of a mobile phone, or may be configured to perform various types of wired communication.
  • the core transmission unit 518 can transmit information to an external device.
  • the core transmission unit 518 transmits information handed over from the core control unit 511, such as information stored in the core storage unit 521.
  • the core receiving unit 519 receives information transmitted from another device.
  • the core receiving unit 519 passes the received information to, for example, a process performed by the core control unit 511.
  • the core receiving unit 519 receives the information transmitted from the target device 580b in the information acquisition mode.
  • the core receiving unit 519 may receive, for example, information transmitted from a device connected via a network such as the information processing device 10 in the output mode.
  • the core receiving unit 519 receives the control instruction information transmitted from the information processing apparatus 10 in the output mode.
  • the core receiving unit 519 receives information based on the image acquired by the camera 581 from the target device 580b.
  • the core receiving unit 519 receives information acquired by the camera processing unit 583, including two or more images acquired by the camera 581.
  • the core receiving unit 519 may receive the image itself acquired by the camera 581. That is, the information based on the image acquired by the camera 581 may be the image acquired by the camera 581 or the information acquired from the image.
  • FIG. 27 is a block diagram showing the configuration of the core control unit 511 of the processing device 510.
  • the core control unit 511 is, for example, a core storage unit 521, a target control unit 531, an output information acquisition unit (an example of a second processing unit) 533, a device identifier acquisition unit 535, a position identifier acquisition unit 536, and a core. It is provided with an output unit 541.
  • the portion of the core control unit 511 excluding the core storage unit 521 can usually be realized from an MPU, a memory, or the like.
  • the processing procedure of the cocoa control unit 511 is usually realized by software, and the software is recorded in a recording medium such as ROM. However, it may be realized by hardware (dedicated circuit).
  • the core storage unit 521 is realized by, for example, a non-volatile recording medium, but it can also be realized by a volatile recording medium.
  • the core storage unit 521 stores, for example, information received by the core receiving unit 519, information acquired by each unit of the core control unit 51 as described later, and the like, and information is stored in each unit of the core storage unit 521.
  • the process of memorizing such information is not limited to this.
  • information or the like may be stored in the core storage unit 521 via a recording medium, or information or the like transmitted via a communication line or the like may be stored in the core storage unit 521.
  • Well, or the information input via the input device may be stored in the core storage unit 521.
  • the information received by the core receiving unit 519 is stored in the core storage unit 521.
  • the core storage unit 521 stores set values related to information output and the like (for example, any setting value that defines a destination, a transmission method, etc.) and is used for processing performed by the core control unit 511. Will be.
  • the core storage unit 521 includes an instruction storage unit 523.
  • the instruction storage unit 523 stores preset control instructions for controlling the operation of the camera 581.
  • the control instruction includes an instruction regarding the timing of acquiring an image of an aquatic animal. Specifically, for example, in the information acquisition mode, a setting value related to an image acquisition time, an image shooting interval, an image acquisition method, and the like (for example, a setting value related to image quality and the like) are included.
  • the target control unit 531 controls the operation of the camera 581 based on the control instruction stored in the instruction storage unit 523. For example, various operations such as shooting and setting for shooting can be controlled.
  • the content of the control may include, for example, an instruction to start or stop shooting, an instruction to control the camera 581, an instruction to transmit transmission information, an instruction to transmit status information indicating the state of the target device 580b, and the like.
  • the output information acquisition unit 533 acquires output information for use in other devices by using the information received by the core reception unit 519. In other words, the output information acquisition unit 533 executes a second process of acquiring output information using the information received by the core reception unit 519.
  • the information to be used in other devices is the image selected by thinning out a part of all the images when they are acquired, and the number of fish, body length, identifier, and health condition based on the selected image. Information such as, but is not limited to these.
  • the device identifier acquisition unit 535 acquires the device identifier from the information received by the core receiving unit 519. That is, it can be said that this device identifier is information that identifies the target device 580b, which is the source of the information received by the core receiving unit 519.
  • the position identifier acquisition unit 536 acquires the position identifier from the information received by the core receiving unit 519. That is, it can be said that the acquired position identifier is information for identifying the position where the image was acquired by the camera 581. When each image corresponds to the cage P, the position identifier may be said to be information for identifying the cage P.
  • the core output unit 541 outputs information based on the information received by the core receiving unit 519.
  • the information based on the received information may be the received information itself, or may be information obtained by processing the received information such as the information acquired from the received information. Further, the output may include transmission to an external device such as the information processing device 10, audio output, image display, storage in the core storage unit 521, and the like.
  • the core output unit 541 outputs the output information acquired by the output information acquisition unit 533.
  • the core output unit 541 outputs output information to the external information processing device 10 by the core transmission unit 518.
  • the core output unit 541 outputs the output information in association with the device identifier acquired by the device identifier acquisition unit 535.
  • the core output unit 541 outputs the output information together with the target device 580b from which the output information is derived, together with the identifiable information.
  • An identifier that identifies the target device 580b, which is the same as the device identifier acquired by the device identifier acquisition unit 535, by another method (the identifier may also be regarded as the "device identifier acquired by the device identifier acquisition unit 535"). It may be output in association with each other.
  • the core output unit 541 outputs the output information in association with the position identifier acquired by the position identifier acquisition unit 536. In other words, the core output unit 541 outputs the output information together with the information that can identify the place where the image from which the output information is obtained is acquired.
  • An identifier that identifies the position corresponding to the position identifier acquired by the position identifier acquisition unit 536, the cage P, or the like by another method (the identifier may also be regarded as the "position identifier acquired by the position identifier acquisition unit 536"). It may be output in association with and.
  • the core output unit 541 is configured to output information when a predetermined output condition is satisfied. For example, it is configured to output information when the operation mode is the output mode.
  • the core control unit 511 may determine whether or not the core output unit 541 is in a state of outputting information (which may be paraphrased as whether or not the operation mode is the output mode).
  • the output condition for example, a condition related to the following elements can be mentioned.
  • the output condition may be that any one of these conditions is satisfied, that any of the two or more conditions is satisfied, or that any of the two or more conditions is satisfied. good.
  • the output condition may include a condition relating to the supply state of electric energy from the power supply unit 516 to the target device 580b.
  • the core output unit 541 can be configured to output information when electric energy is not supplied from the power supply unit 516 to the target device 580b.
  • information is output by the core transmitter 518, it is necessary to use a relatively large amount of electrical energy. With such a configuration, information can be reliably output.
  • the output condition may include a condition regarding whether or not the cartridge housing 510f is removed from the target device 580b and whether or not the cartridge housing 510f is attached to the charging device 590.
  • it may include a condition regarding whether or not the processing device 510 is attached to the target device 580b and whether or not the processing device 510 is attached to the charging device 590.
  • the core output unit 541 outputs information, and when the processing device 510 is attached to the target device 580b, the information is output. It can be configured not to do.
  • Information can be output to.
  • the output condition may include a condition relating to the state of the secondary battery 517.
  • a condition regarding whether or not the secondary battery 517 is fully charged and whether or not the secondary battery 517 is charged to a predetermined degree or more may be included.
  • a condition regarding whether or not the secondary battery 517 is being charged by the electric energy supplied from the outside may be included.
  • the core output unit 541 is configured to output information when the secondary battery 517 is being charged or fully charged by electric energy supplied from the outside. be able to. With such a configuration, it is possible to prevent a power shortage and reliably output information.
  • the fully charged state is a state in which the electric charge is sufficiently stored.
  • a state in which a predetermined amount or more of electric charge is stored such as a state in which the voltage of the secondary battery 517 is equal to or higher than a predetermined threshold value, may be referred to as a fully charged state.
  • FIG. 28 is a flowchart showing an example of the operation of the processing device 510.
  • Step S511 The core control unit 511 determines whether or not the processing device 510 is in the output mode. In other words, the core control unit 511 determines whether or not the output condition is satisfied. If it is determined that the output mode is set, the process proceeds to step S521, and if not, the process proceeds to step S512.
  • Step S512 The target control unit 531 controls the operation of the camera 581 based on the control instruction stored in the instruction storage unit 523.
  • Step S513 The core receiving unit 519 receives the transmission information transmitted from the target device 580b.
  • Step S5114 The output information acquisition unit 533 acquires output information based on the received information.
  • the output information acquisition unit 533 stores the acquired output information in, for example, the core storage unit 521. After that, the process returns to step S511.
  • Step S521 In the output mode, the core control unit 511 determines whether or not the information can be transmitted by the core transmission unit 518. In other words, the core control unit 511 determines whether or not it is possible to communicate with the destination device (for example, the information processing device 10) via the network. If it is determined that the information can be transmitted, the process proceeds to step S522, and if not, the process returns to step S511.
  • the destination device for example, the information processing device
  • Step S522 The core output unit 541 transmits the output information acquired by the output information acquisition unit 533 to the information processing device 10 or the like. If there is no output information to be transmitted, this process may be skipped.
  • Step S523 The core output unit 541 erases (clears) the transmitted output information from the core storage unit 521. As a result, the storage area of the core storage unit 521 can be secured and new output information can be stored. The output information may not be erased. After that, the process returns to step S511.
  • the processing may be terminated by an interrupt of power off or processing termination.
  • FIG. 29 is a flowchart showing a modified example of the operation of the processing device 510.
  • the acquisition of output information may be performed in the output mode.
  • this processing is performed in the output mode in which the electric power can be sufficiently used, and the processing is surely or promptly performed. It may be possible to acquire output information.
  • the process of the following step S514B is performed instead of the step S514, and the process of the following step S520B is performed before the step S521. Just do it.
  • Step S514B That is, instead of step S514, the core receiving unit 519 stores the received information in the core storage unit 521 and returns to step S511.
  • Step S520B the output information acquisition unit 533 performs a process of acquiring output information using the information stored in the core storage unit 521. After that, the processing after step S521 is performed.
  • the image acquisition device 580 and the like are acquired by the information collecting device 580 by the control performed by the processing device 510 in this way, even if the user is not waiting at the farm, the user does not have to wait at the farm. Information can be collected. Therefore, the detection operation can be easily performed as in the second embodiment. Since the processing device 510 can supply electric energy to the target device 580b of the information collecting device 580, the target device 580b can be continuously driven for a long time by performing work such as replacing the processing device 510 in a timely manner. , It becomes possible to collect information. Therefore, it is possible to reduce the management burden of the information collecting device 580 performed at sea or the like, which is carried by the user.
  • the processing device 510 can be used by removing it from the target device 580b. Therefore, for example, it is possible to appropriately combine a plurality of processing devices 510 and a smaller number of target devices 580b to collect information in a plurality of cages P, thereby enhancing the convenience of the information collecting device 580. be able to. Further, the processing device 510 and the target device 580b can be managed separately, and maintenance or replacement such as repair at the time of failure can be performed. Therefore, it is possible to keep the cost required for continuing the collection of information in the cage P at a plurality of locations low.
  • the processing device 510 With the processing device 510 removed from the target device 580b, it is possible to output information by the processing device 510 alone. Therefore, the information can be easily output by carrying only the processing device 510 to a place or situation suitable for outputting the information. For example, when information is transmitted from the processing device 510 using a predetermined communication environment, even if the communication environment is not set up at the installation location of the target device 580b such as at sea, the processing device 510 is set up in a communication environment. Can be moved to to carry out the transmission of information. Further, even when electric power is required at the time of information transmission, the processing device 510 can be moved to an environment where sufficient electric power can be obtained to carry out information transmission. Therefore, information can be output easily and reliably.
  • the information transmission process that consumes a large amount of power can be performed during charging of the processing device 510, it is possible to reduce the capacity of the secondary battery 517 of the processing device 510.
  • the hardware of the information collecting device 580 can be simplified, and the cost of the information collecting device 580 can be reduced.
  • the core receiving unit 519 receives two or more images acquired by the camera 581, and the output information acquisition unit 533 performs an image selection process as follows, for example, as a process of acquiring the output information. May be good. That is, in the image selection process, the output information acquisition unit 533 has a smaller number of images than the number of images received by the core receiving unit 519 among the images received by the core receiving unit 519 based on a predetermined image selection condition. To get.
  • the image selection condition various conditions such as a condition regarding the position of the aquatic animal, a condition regarding the presence or absence of the aquatic animal in the image, a condition regarding the photographing time and the imaging interval, and the like can be used.
  • the condition regarding the position of the aquatic animal can be set so that the aquatic animal is shown at a position displaced by a predetermined amount or more from the position of the aquatic animal in the image taken immediately before.
  • the output information acquisition unit 533 displays an image of the aquatic animal in the image received by the core receiving unit 519 at a position displaced by a predetermined amount or more from the position of the aquatic animal in the image taken immediately before. You may try to get it. Further, for example, even if only images related to aquatic animals of a predetermined fish species are selected, or only images judged to be good in the process of measuring body length or the like are selected. good. Such a determination may be performed by using a known technique such as classification by machine learning, or may be performed by another method.
  • the image selection process may be performed on the image of each frame, or whether the image selection condition is satisfied for each of the plurality of moving images in a short time. It may be possible to make a judgment such as whether or not.
  • FIG. 30 is a flowchart showing an example of the output information acquisition process of the output information acquisition unit 533.
  • Step S531 The output information acquisition unit 533 targets the next target image among the unprocessed images received by the core reception unit 519.
  • Step S532 The output information acquisition unit 533 determines whether or not the image selection condition is satisfied for the image to be processed. If it is determined that the condition is satisfied, the process proceeds to step S532, and if not, the process proceeds to step S534.
  • Step S533 The output information acquisition unit 533 selects an image to be processed as output information.
  • Step S534 The output information acquisition unit 533 determines whether or not the determination for all the images is completed. If it is determined that the process is completed, the process returns to the higher-level process, and if not, the process returns to step S531.
  • the number of images included in the output information is smaller than the number of images acquired by the camera 581. Therefore, the data size output by the core output unit 541 is reduced, and the load and time required for information output can be reduced.
  • the output information acquisition unit 533 may be configured to acquire information on the aquatic animal being raised as output information based on the image received by the core reception unit 519.
  • information such as the number of aquatic animals, body length, identifier of aquatic animals, health condition, etc. may be acquired, and the present invention is not limited to these.
  • Such a function may be performed, for example, in the same manner as that performed by the detection processing unit 31 in the above-described embodiment.
  • the output information acquisition unit 533 measures the size of aquatic animals and the like by performing the same processing as the image acquisition unit 32 and the detection unit 33 (including the operation of the measurement unit 34). The results may be obtained as information about the aquatic animals being raised.
  • the output information acquisition unit 533 detects the color and shape of an aquatic animal, compares it with data showing a standard color and shape, and based on the comparison result, information indicating the presence or absence of abnormal growth of the aquatic animal. May be output as output information.
  • the output information acquisition unit 533 may acquire environmental information regarding the breeding environment of aquatic animals, and may acquire output information regarding the aquatic animals being raised based on the acquired environmental information.
  • the environmental information the information acquired by the environment sensor 84, which is transmitted from the target device 580b and received by the core receiving unit 519, may be used. Further, the information acquired based on such information may be used as environmental information.
  • the following information may be applicable to the environmental information.
  • the color of seawater and information on other existing organisms may be acquired as environmental information.
  • environmental information By using such environmental information, it is possible to output information indicating the presence or absence of an abnormality in the marine environment as output information so that the user can take countermeasures as necessary.
  • the presence / absence and degree of adhesion to the camera 581, the degree of cloudiness detected by the camera 581, the degree of cloudiness, and the like may be acquired as environmental information. Based on such environment information, for example, it is possible to output information indicating the presence or absence of an abnormality in the shooting environment so that the user can take countermeasures as necessary.
  • the camera processing unit 583 may perform such processing.
  • the information acquired by the processing may be transmitted from the target device 580b and received by the core receiving unit 519.
  • the above-mentioned image selection process may be performed on the target device 580b side.
  • the camera processing unit 583 selects the image acquired by the camera 581 based on the image selection condition, and the core receiving unit 519 can receive only the selected image.
  • necessary processing may be appropriately performed, for example, information acquisition processing based on the received image.
  • the transmission of the output information to the information processing apparatus 10 or the like can be performed away from the scene where the image is taken by the target device 580b, and the same effect as described above can be obtained.
  • the processing device 510 may be configured to be able to communicate with an external device even in the information acquisition mode. For example, when a user performs a predetermined operation input, wireless communication is performed between the processing device 510 and an information communication terminal or the like (for example, a smartphone) prepared near the processing device 510 by using, for example, a predetermined short-range communication method. May be able to do.
  • the core output unit 541 may be able to transmit output information to the information communication terminal. The user can check the output information at the site where the processing device 510 is used regardless of the surrounding communication environment. Further, when such wireless communication is possible, a predetermined control instruction may be transmitted from the information communication terminal to the core control unit 511. The user can instruct the predetermined operation to be performed at the site where the processing device 510 is used regardless of the surrounding communication environment.
  • the processing in this embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded on a recording medium such as a CD-ROM and disseminated.
  • the software that realizes the processing device in this embodiment is the following program. In other words, this program is used together with a target device that has an image acquisition unit that acquires images of aquatic animals being raised, and a computer of a processing device that has a power supply unit that supplies electrical energy to the target device is imaged from the target device.
  • This is a program for functioning as a core receiving unit that receives information based on an image acquired by an acquisition unit and a core output unit that outputs information based on the information received by the core receiving unit.
  • the information processing device may calculate the time when it is recommended to perform the detection work next and notify the user. For example, when the growth state is close to the ready-to-ship state or the growth state is close to the abnormal value, the period until the next detection opportunity is relatively short, and the normal growth state can be shipped. If it is expected that it will take some time to reach the state, the period until the next detection opportunity may be relatively long.
  • the fish activity index (satiation index) may be obtained by quantifying the swimming activity rate of aquatic animals by image analysis or machine learning.
  • the bait it is preferable to change the bait to a larger size or a reduced amount of fishmeal according to the growth of aquatic animals. Therefore, information that identifies the relationship between the pre-stored bait information (size, type) and the fish body size is stored in advance in the storage unit of the information processing device, and the optimum bait for the fish body size measured in real time is determined. , The user may be notified. In this case, the information processing device may acquire information on the food currently being fed and notify the user when the optimum food and the registered food are different.
  • the processing unit of the information processing device has obtained the growth rate of fish under similar conditions obtained from the same past cage, the current adjacent cage, or the cage of another producer.
  • a benchmark (mean or median) may be calculated from the feeding method (amount and time) so that it can be displayed and compared in real time. Based on the comparison result with such other actual results, the user can make a multifaceted evaluation of the current growth situation.
  • the processing unit may also recommend an appropriate feeding method to bring it closer to the benchmark.
  • the detection unit of the information processing device may detect an abnormal value based on the relationship of each parameter of the past biological information stored in the biological information storage unit. For example, it is possible to detect whether or not overfeeding or undergrowth has occurred by comparing the relationship between the past feeding amount and the change in the size of aquatic animals with the current information.
  • the information processing apparatus may accept the input of information performed by the worker who has confirmed the image taken by the camera, and may acquire information such as the fish body length based on the received information.
  • the information processing device transmits an image or an analysis result of the image to the terminal device operated by the worker, and then the information processing device receives the information transmitted from the terminal device operated by the worker. You just have to do it.
  • the result of the detection by the detection unit may be transmitted to the worker as a provisional one, and the worker may confirm whether or not the transmitted information is appropriate. ..
  • biological information may be accumulated based on the detection result confirmed to be appropriate by the operator.
  • the worker identifies the area of the object contained in the image, annotates the attribute of the area (whether or not it is an aquatic organism, etc.), and measures based on the result. May be done. As described above, even when the work by the worker intervenes or the work by the worker and the processing performed by the information processing apparatus are performed in parallel, the detection work can be easily performed.
  • each part may be described by indicating a certain direction, but the clarification of the direction is merely for convenience of explanation, and each device and the like according to the present invention may be described. It does not limit the orientation or posture during use.
  • the acquisition may include acquiring information stored in advance in the own device or another device, as well as acquiring information generated by information processing performed in the device. ..
  • the classifier that can be used to acquire information is not limited to the classifier obtained by machine learning.
  • the classifier may be, for example, a table showing the correspondence between the input vector based on the input information and the output information.
  • the output information corresponding to the feature vector based on the input information may be acquired from the table, or input using two or more input vectors in the table and a parameter for weighting each input vector.
  • a vector that approximates the feature vector based on the information may be generated, and the final output information may be obtained by using the output information and the parameters corresponding to each input vector used for the generation.
  • the classifier may be, for example, a function representing a relationship between an input vector based on input information and the like and information for generating output information. In this case, for example, the information corresponding to the feature vector based on the input information may be obtained by a function, and the output information may be acquired using the obtained information.
  • FIG. 31 is an overview diagram of the computer system 800 in the above embodiment.
  • FIG. 32 is a block diagram of the computer system 800.
  • the computer system 800 includes a computer 801 including a CD-ROM drive, a keyboard 802, a mouse 803, and a monitor 804.
  • the computer 801 is connected to the MPU 8013, the bus 8014 connected to the CD-ROM drive 8012, the ROM 8015 for storing programs such as boot-up programs, and the MPU 8013. It includes a RAM 8016 for temporarily storing program instructions and providing a temporary storage space, and a hard disk 8017 for storing application programs, system programs, and data.
  • the computer 801 may further include a network card that provides a connection to the LAN.
  • the program for causing the computer system 800 to execute the functions of the information processing apparatus and the like according to the above-described embodiment may be stored in the CD-ROM 8101, inserted into the CD-ROM drive 8012, and further transferred to the hard disk 8017.
  • the program may be transmitted to the computer 801 over a network (not shown) and stored on the hard disk 8017.
  • the program is loaded into RAM 8016 at run time.
  • the program may be loaded directly from the CD-ROM 8101 or the network.
  • the program does not necessarily have to include an operating system (OS) or a third-party program that causes the computer 801 to execute the functions of the information processing apparatus and the like according to the above-described embodiment.
  • the program need only include a portion of the instruction that calls the appropriate function (module) in a controlled manner to obtain the desired result. It is well known how the computer system 800 works, and detailed description thereof will be omitted.
  • processing performed by hardware for example, processing performed by a modem or interface card in the transmission step (only performed by hardware). Processing that is not done) is not included.
  • the number of computers that execute the above program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.
  • the two or more components existing in one device may be physically realized by one medium.
  • each process may be realized by centralized processing by a single device (system), or may be realized by distributed processing by a plurality of devices. (In this case, it is possible to grasp the entire system composed of a plurality of devices that perform distributed processing as one "device").
  • the transfer of information performed between the components is performed by, for example, one of the components when the two components that transfer the information are physically different. It may be performed by outputting information and accepting information by the other component, or if the two components that pass the information are physically the same, one component. It may be performed by moving from the processing phase corresponding to the other component to the processing phase corresponding to the other component.
  • each component information related to the processing executed by each component, for example, information received, acquired, selected, generated, transmitted, or received by each component. Further, information such as threshold values, mathematical formulas, addresses, etc. used by each component in processing may be temporarily or for a long time held in a recording medium (not shown), even if it is not specified in the above description.
  • each component or a storage unit may store information on a recording medium (not shown). Further, the information may be read from the recording medium (not shown) by each component or a reading unit (not shown).
  • the information used in each component or the like for example, the information such as the threshold value and the address used in the processing by each component and various setting values may be changed by the user, the above-mentioned
  • the user may or may not be able to change the information as appropriate.
  • the change is realized by, for example, a reception unit (not shown) that receives a change instruction from the user and a change unit (not shown) that changes the information in response to the change instruction. You may.
  • the reception unit may accept the change instruction from, for example, an input device, information transmitted via a communication line, or information read from a predetermined recording medium. ..
  • An embodiment may be configured by appropriately combining the above-mentioned plurality of embodiments.
  • the present invention is not limited to the configuration itself of the above-described embodiment, and each component of the above-described embodiment may be appropriately replaced or combined with the component of another embodiment. Further, some of the components and functions may be omitted from the above-described embodiments.
  • the processing apparatus according to the present invention has the effect that the information acquired at the growing place can be easily output, and is useful as a processing apparatus or the like.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Environmental Sciences (AREA)
  • Marine Sciences & Fisheries (AREA)
  • Zoology (AREA)
  • Animal Husbandry (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Catching Or Destruction (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

Selon le problème abordé par l'invention, des dispositifs de traitement classiques ont des difficultés à fournir des informations acquises sur un site d'élevage. La solution selon l'invention concerne un dispositif de traitement (510) qui est utilisé conjointement avec un instrument cible (580b) équipé d'une caméra (581) pour acquérir une image d'un animal aquatique qui est élevé, et comprend : une unité de réception centrale permettant de recevoir, de l'instrument cible (580b), des informations basées sur une image acquise par la caméra (581) ; une unité de sortie centrale permettant de fournir en sortie des informations en fonction des informations reçues par l'unité de réception centrale ; et une unité d'alimentation électrique permettant de fournir de l'énergie électrique à l'instrument cible (580b). Il est possible de fournir facilement en sortie des informations acquises sur un site d'élevage en utilisant le dispositif de traitement (510).
PCT/JP2020/046084 2020-12-10 2020-12-10 Dispositif de traitement, dispositif de collecte d'informations, procédé de traitement d'informations, et programme WO2022123732A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/046084 WO2022123732A1 (fr) 2020-12-10 2020-12-10 Dispositif de traitement, dispositif de collecte d'informations, procédé de traitement d'informations, et programme

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/046084 WO2022123732A1 (fr) 2020-12-10 2020-12-10 Dispositif de traitement, dispositif de collecte d'informations, procédé de traitement d'informations, et programme

Publications (1)

Publication Number Publication Date
WO2022123732A1 true WO2022123732A1 (fr) 2022-06-16

Family

ID=81973410

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/046084 WO2022123732A1 (fr) 2020-12-10 2020-12-10 Dispositif de traitement, dispositif de collecte d'informations, procédé de traitement d'informations, et programme

Country Status (1)

Country Link
WO (1) WO2022123732A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7538938B1 (ja) 2023-12-14 2024-08-22 日鉄エンジニアリング株式会社 給餌システムおよび学習モデル生成方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018042651A1 (fr) * 2016-09-05 2018-03-08 謙 藤原 Système d'alimentation et procédé d'alimentation
JP2020018312A (ja) * 2018-03-02 2020-02-06 ウミトロン ピーティーイー エルティーディー 自動給餌支援装置、自動給餌支援方法、およびプログラム
JP6695585B1 (ja) * 2019-06-12 2020-05-20 ウミトロン ピーティーイー エルティーディー 水棲動物養殖支援システム、昇降装置、給餌装置、水棲動物の養殖方法、及び水棲動物養殖支援プログラム
JP2020110138A (ja) * 2019-05-15 2020-07-27 株式会社ＦｕｌｌＤｅｐｔｈ 魚監視システム及びカメラユニット

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018042651A1 (fr) * 2016-09-05 2018-03-08 謙 藤原 Système d'alimentation et procédé d'alimentation
JP2020018312A (ja) * 2018-03-02 2020-02-06 ウミトロン ピーティーイー エルティーディー 自動給餌支援装置、自動給餌支援方法、およびプログラム
JP2020110138A (ja) * 2019-05-15 2020-07-27 株式会社ＦｕｌｌＤｅｐｔｈ 魚監視システム及びカメラユニット
JP6695585B1 (ja) * 2019-06-12 2020-05-20 ウミトロン ピーティーイー エルティーディー 水棲動物養殖支援システム、昇降装置、給餌装置、水棲動物の養殖方法、及び水棲動物養殖支援プログラム

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7538938B1 (ja) 2023-12-14 2024-08-22 日鉄エンジニアリング株式会社 給餌システムおよび学習モデル生成方法

Similar Documents

Publication Publication Date Title
JP6842100B1 (ja) 水棲動物検出装置、情報処理装置、端末装置、水棲動物検出システム、水棲動物検出方法、及び水棲動物検出プログラム
JP6695585B1 (ja) 水棲動物養殖支援システム、昇降装置、給餌装置、水棲動物の養殖方法、及び水棲動物養殖支援プログラム
US10856520B1 (en) Methods for generating consensus feeding appetite forecasts
WO2019168108A1 (fr) Dispositif d'aide à l'alimentation automatique, procédé d'aide à l'alimentation automatique, et support d'enregistrement
CN109717120A (zh) 一种基于物联网的鱼类养殖监测投料系统及方法
KR101598898B1 (ko) 음향 및 영상분석을 통한 넙치 질병 예방 시스템
EP1510125B1 (fr) Procédé d'observation et de contrôle de nourriture non consommée en pisciculture
JP2019170349A (ja) 水生生物生産管理システム
CN203492583U (zh) 一种预防南美白对虾养殖水体富营养化的视频监控装置
JP2020078278A (ja) 養殖魚の自動給餌方法並びに自動給餌システム
CN103858807A (zh) 基于物联网的投饵机终端
CN114467824B (zh) 智能投饵船
US20230284600A1 (en) Smart aquaculture grow out system
CN114994299B (zh) 反刍动物碳排放气体检测方法、装置及系统
Karningsih et al. Automated fish feeding system for an offshore aquaculture unit
CN107242176A (zh) 一种网箱养殖系统
WO2022123732A1 (fr) Dispositif de traitement, dispositif de collecte d'informations, procédé de traitement d'informations, et programme
KR20160141247A (ko) 넙치 습성을 이용한 음향분석 먹이활성도 분석 시스템
JP2021136965A (ja) 養殖管理装置、養殖管理方法及び給餌ロボット
CN109845654A (zh) 喂养系统及喂食方法
CN106094700A (zh) 一种用于池塘养殖的饲料抛撒控制方法
KR101753221B1 (ko) 모바일 디바이스를 기반으로 하는 생태통합양식 관리시스템 어플 장치
Palconit et al. IoT-based On-demand Feeding System for Nile Tilapia (Oreochromis niloticus)
WO2023226563A1 (fr) Procédé et système d'identification de croissance animale
TWI836453B (zh) 動物生長辨識方法及其系統

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20965114

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20965114

Country of ref document: EP

Kind code of ref document: A1