WO2021038753A1 - Dispositif de détection d'animal aquatique, dispositif de traitement d'informations, dispositif de terminal, système de détection d'animal aquatique, procédé de détection d'animal aquatique et programme de détection d'animal aquatique - Google Patents

Dispositif de détection d'animal aquatique, dispositif de traitement d'informations, dispositif de terminal, système de détection d'animal aquatique, procédé de détection d'animal aquatique et programme de détection d'animal aquatique Download PDF

Info

Publication number
WO2021038753A1
WO2021038753A1 PCT/JP2019/033711 JP2019033711W WO2021038753A1 WO 2021038753 A1 WO2021038753 A1 WO 2021038753A1 JP 2019033711 W JP2019033711 W JP 2019033711W WO 2021038753 A1 WO2021038753 A1 WO 2021038753A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
unit
notification
detection
aquatic animal
Prior art date
Application number
PCT/JP2019/033711
Other languages
English (en)
Japanese (ja)
Inventor
謙 藤原
Original Assignee
ウミトロン ピーティーイー エルティーディー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ウミトロン ピーティーイー エルティーディー filed Critical ウミトロン ピーティーイー エルティーディー
Priority to JP2020508060A priority Critical patent/JP6842100B1/ja
Priority to PCT/JP2019/033711 priority patent/WO2021038753A1/fr
Priority to JP2021015663A priority patent/JP2021164444A/ja
Publication of WO2021038753A1 publication Critical patent/WO2021038753A1/fr

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01KANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
    • A01K61/00Culture of aquatic animals
    • A01K61/10Culture of aquatic animals of fish
    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01KANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
    • A01K61/00Culture of aquatic animals
    • A01K61/90Sorting, grading, counting or marking live aquatic animals, e.g. sex determination
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A40/00Adaptation technologies in agriculture, forestry, livestock or agroalimentary production
    • Y02A40/80Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in fisheries management
    • Y02A40/81Aquaculture, e.g. of fish

Definitions

  • the present invention is an aquatic animal detection device, an information processing device, a terminal device, an aquatic animal detection system, an aquatic animal detection method, and an aquatic animal detection device that detects aquatic animals in an image (including a moving image) taken by a camera. It's about the program.
  • Patent Document 1 describes a growth state monitoring method for monitoring the growth state of aquatic animals growing in an aquarium, and the position of the aquatic animal in the aquarium using images detected from two imaging systems. And what is required for size is disclosed.
  • the aquatic animal detection device of the first invention has an image acquisition unit that acquires an image taken by a camera, a detection unit that detects the aquatic animal shown in the image, and a notification regarding the detection status of the aquatic animal by the detection unit.
  • a notification judgment unit that determines whether or not the conditions are met, a notification generation unit that generates notification information when the notification judgment unit determines that the notification conditions are met, and a notification output that outputs the generated notification information. It is an aquatic animal detection device equipped with a part.
  • the detection unit detects the aquatic animal immediately after the image is taken, and the notification condition is the detection of the aquatic animal.
  • An aquatic animal detector that includes conditions for progress.
  • the aquatic animal detection device of the third invention is an aquatic animal detection device for the second invention, in which the notification condition includes a condition relating to the total number of detected aquatic animals.
  • the aquatic animal detection device of the fourth invention relates to any one of the first to third inventions, and the notification condition includes a condition relating to the positional relationship between the camera and the aquatic animal detected from the image. It is an animal detection device.
  • the aquatic animal detection device of the fifth invention is an aquatic animal detection device in which the camera is a stereo camera for any one of the first to fourth inventions.
  • aquatic animals can be detected with high accuracy based on the images taken by the stereo camera.
  • the aquatic animal detection device of the sixth invention is generated by a display unit for displaying an image taken by a camera and a notification generation unit on the display unit for any one of the first to fifth inventions. It is an aquatic animal detection device equipped with an output unit that outputs notification information.
  • the notification information is output to the display unit that displays the image, so that the aquatic animal detection work in the water can be easily performed.
  • the aquatic animal detection device of the seventh invention further includes a measuring unit for measuring the aquatic organisms shown in the image for any one of the first to sixth inventions, and the notification determination unit is It is determined whether or not the second notification condition regarding the measurement result by the measurement unit is satisfied, and the notification generation unit generates the second notification information when the notification determination unit determines that the second notification condition is satisfied. It is an aquatic animal detection device.
  • the information processing apparatus of the eighth invention relates to the shooting situation of the image taken by the camera, including the biological information storage unit and the shooting time information, for any one of the first to seventh inventions.
  • the status information acquisition unit that acquires the status information, the biological information acquisition unit that acquires the biological information about the aquatic animal detected by the detection unit of the aquatic animal detection device based on the image, and the biological information and the shooting status information are associated with each other.
  • the photographing status information includes the feeding information regarding the feeding work performed on the photographed aquatic animal, and the growth state determination unit , An information processing device that determines whether or not the growth of aquatic animals is abnormal based on biological information and feeding information.
  • the information processing apparatus of the tenth invention includes a growth plan information storage unit for storing growth plan information indicating a preset growth plan for the eighth or ninth invention, and is provided with a growth plan information storage unit. Is an information processing device that determines the growth state of aquatic animals based on biological information and growth plan information.
  • the information processing apparatus of the eleventh invention relates to any one of the eighth to tenth inventions with respect to aquatic animals based on the determination result regarding the growth state of aquatic animals by the growth state determination unit. It is an information processing device including a feeding instruction information generation unit that generates feeding instruction information regarding the feeding work to be performed.
  • feeding instruction information regarding feeding work can be obtained.
  • the photographing status information includes a cage identifier for identifying a cage in which aquatic animals have been detected.
  • the growth state determination unit is an information processing device that determines the growth state of aquatic animals for each of the same cages.
  • the information processing apparatus of the thirteenth invention is based on the cage identifier and the photographing time information corresponding to the biological information stored in the biological information storage unit for each cage.
  • the unfinished cage determination unit that determines whether or not the detection work was performed using the detection unit of the aquatic animal detection device at one detection opportunity, and the cage that was determined that the detection work was not performed by the unfinished cage determination unit.
  • This is an information processing device including an unfinished cage information generation unit that generates unfinished cage information that identifies the cage when there is.
  • the information processing apparatus of the fourteenth invention has a shipping standard information storage unit for storing shipping standard information indicating a preset shipping standard for any one of the eighth to thirteenth inventions.
  • the growth state determination unit is an information processing device that determines whether or not the growth state of the aquatic animal satisfies the shipping standard based on the biological information and the shipping standard information.
  • the terminal device of the fifteenth invention is a terminal device capable of communicating with the aquatic animal detection device according to any one of the first to sixth inventions, and immediately displays an image taken by a camera.
  • the user can receive a notification regarding the detection status of aquatic animals while checking the image taken by the camera, so that the aquatic animal detection work in water can be easily performed.
  • the aquatic animal detection system of the sixteenth invention detects a camera, a jig to which the camera is attached, an image acquisition unit that acquires an image taken by the camera, and an aquatic animal appearing in the image.
  • the aquatic animal detection system of the seventeenth invention is an aquatic animal detection system in which, in contrast to the sixteenth invention, the jig has a hook that is hooked on a constituent member constituting the cage. ..
  • the camera can be easily attached to the constituent members at the time of shooting, and the work involving the detection of aquatic animals in water can be easily performed.
  • FIG. 1 Schematic diagram of the aquatic animal detection system according to the first embodiment of the present invention Block diagram of the aquatic animal detection system Block diagram of the information processing device Perspective view showing an example of the camera
  • the figure explaining the detection work using the camera Flow chart explaining an example of the operation of the information processing device Flow chart showing an example of the operation at the time of detection Flow chart showing an example of the detection process Flow chart showing an example of operation at the time of judgment
  • a table explaining the operation of the feeding instruction information generator A flowchart showing an example of the operation related to the correction of model information by the processing unit.
  • Block diagram of an aquatic animal detection system according to a modified example of the first embodiment Block diagram of the information processing device Schematic diagram of the aquatic animal detection system according to the second embodiment of the present invention
  • Block diagram of the aquatic animal detection system Perspective view showing the schematic configuration of the camera unit Perspective view showing an arrangement example of the camera Schematic diagram of the aquatic animal detection system according to the third embodiment of the present invention
  • Block diagram of the aquatic animal detection system Overview of the computer system according to the above embodiment Block diagram of the computer system
  • the aquatic animal is, for example, a fish, but is not limited to this, and any animal such as a crustacean or a shellfish that lives in water may be used.
  • any animal such as a crustacean or a shellfish that lives in water may be used.
  • aquatic animals when aquatic animals are described, they are sometimes referred to as fish on behalf of them, and the bodies of the aquatic animals are sometimes referred to as fish bodies.
  • the image is, for example, a still image or a moving image taken by a camera, but is not limited to this.
  • it may be a still image extracted from a moving image taken by a camera.
  • the aquatic animal detection system can be used, for example, in a cage (aquaculture farm) where aquatic animals are cultivated.
  • the farm may be the sea, a lake, a pond, a river, or the like.
  • a cage is an area filled with water (whether freshwater, seawater, brackish water) for aquatic animal farming, that is, a farm.
  • the environment of the farm may be different depending on the type of aquatic animals to be cultivated.
  • the farm may be naturally formed or artificially created.
  • the farm may be a large aquarium for aquaculture filled with water, whether outdoors or indoors.
  • a plot composed of a part of an area with water may be called a farm.
  • the identifier is a character or code that uniquely indicates the item.
  • the identifier is, for example, an ID, but any type of information can be used as long as it is information that can identify the corresponding item. That is, the identifier may be the name of what it indicates, or it may be a combination of codes so as to correspond uniquely.
  • the acquisition may include acquiring the matters input by the user or the like, or may include acquiring the information stored in another device.
  • Acquiring the information stored in the other device may include acquiring the information stored in the other device via API or the like, or the document file provided by the other device. It may be included to acquire the content (including the content of the web page) by scraping or the like. Further, it may include acquiring information in a format different from the original information based on the original information, such as acquiring information by performing optical character reading on the image file.
  • a so-called machine learning method may be used to acquire information.
  • the use of the machine learning method for example, the following can be performed. That is, a learning device that inputs a specific type of input information and outputs the output information of the type to be acquired is configured by using a machine learning method. For example, two or more sets of input information and output information are prepared in advance, and the two or more sets of information are given to a module for constructing a learning device for machine learning to configure a learning device, and the configured learning device is provided. Accumulate in the storage unit.
  • the learner can also be called a classifier.
  • the machine learning method may be, for example, deep learning, random forest, SVR, or the like. Further, for machine learning, for example, functions in various machine learning frameworks such as fastText, tinySVM, random forest, TensorFlow, and various existing libraries can be used. The learner can also be called a classifier.
  • To output information means to display on a display, project using a projector, print with a printer, output sound, transmit to an external device, store in a recording medium, process to another processing device or other program. It is a concept that includes delivery of results. Specifically, for example, it includes enabling information to be displayed on a web page, transmitting it as an e-mail or the like, and outputting information for printing.
  • Information reception means receiving information input from input devices such as keyboards, mice, and touch panels, receiving information transmitted from other devices via wired or wireless communication lines, optical disks, magnetic disks, and semiconductors. It is a concept including acceptance of information read from a recording medium such as a memory.
  • the aquatic animal detection system is used to detect the number and growing state of aquatic animals such as fish during aquaculture.
  • the detection device of the aquatic animal detection system detects the fish body in the image taken by the camera. At this time, it is determined whether or not the predetermined notification condition regarding the detection of the fish body is satisfied, and when the predetermined notification condition is satisfied, the user is notified of the detection information of the aquatic animal.
  • the notification is performed, for example, by outputting voice or generating vibration from a terminal device used in an aquatic animal detection system or a device linked to the terminal device, but the notification is not limited to this.
  • the notification may be made, for example, in a terminal device having a display unit for displaying an image taken by a camera in an aquatic animal detection system.
  • the information processing device of the aquatic animal detection system acquires the detection information of the fish body detected by the detection device and the environment information corresponding to the captured image, and stores the detection information and the environment information in association with each other. Judgment regarding the growth state of fish is made based on the accumulated information, and the judgment result is output.
  • the predetermined notification conditions include those related to the progress of detection of the fish body.
  • the predetermined notification condition may include the total number of fish detected in the image.
  • the predetermined notification conditions may include those relating to the positional relationship between the fish body and the camera.
  • the detection device may be configured to measure the fish body and give a notification based on the result.
  • the camera is a stereo camera, and a fish body included in an image taken by the stereo camera is detected, but the present invention is not limited to this.
  • the information processing device may make a determination regarding growth abnormality based on time-series biological information and feeding information. Further, the information processing device may output the feeding instruction information based on the determination result regarding the growth state, and may output the feeding instruction information based on the growth plan information and the determination result of the growth state. May be good. The information processing device may make a determination to acquire biological information for each cage and output the determination result, or may output unfinished cage information for identifying the cage for which the determination has not been completed. .. The information processing device may determine whether or not the growth state of the aquatic animal meets a preset shipping standard.
  • FIG. 1 is a schematic view of the aquatic animal detection system 1 according to the first embodiment of the present invention.
  • reference numeral P indicates a cage provided in the sea or the like
  • reference numeral P1 indicates a constituent member (for example, a net surrounding the cage P) constituting the cage P.
  • the aquatic animal detection system 1 includes an information processing device 10, a terminal device 60, a camera unit 80, and an information input device 90.
  • the information processing device 10 also functions as the aquatic animal detection device 10D, but the present invention is not limited to this.
  • the information processing device 10 and the information input device 90 are devices on the remote side (so-called ASP side), and the terminal device 60 and the camera unit 80 are devices on the local side (fish cage P side). I can say.
  • the information processing device 10 and the terminal device 60 can communicate with each other via a network such as the Internet. Further, the information processing device 10 and the information input device 90 can communicate with each other via a network.
  • the camera unit 80 is connected to the terminal device 60.
  • the information processing device 10, the terminal device 60, and the information input device 90 are each connected to a network such as the Internet, but the present invention is not limited to this.
  • the information processing device 10 and the terminal device 60 may be connected to the network, and the information input device 90 may be connected to the information processing device 10.
  • the camera unit 80 may be connected to a network, and the camera unit 80 and the terminal device 60 may be connected via the network.
  • a server device may be provided on the local side, and another local device may be connected to the server device.
  • the information processing device 10 and the information input device 90 may be provided as one of the devices on the local side, and each device is an aquatic animal as described below without distinguishing between the local side and the remote side. It suffices if they are connected to each other so that the operation of the detection system 1 can be performed.
  • a tablet-type information terminal device is shown as a terminal device 60
  • a laptop computer-type device is shown as an information input device 90
  • these devices may be, for example, tablet-type information terminal devices, portable information terminal devices such as so-called smartphones, or personal computers (PCs) such as laptop computers, or devices other than these. You may.
  • the information input device 90 is, for example, a general laptop computer type information terminal device.
  • the information input device 90 is realized from a storage unit, an MPU, a memory, etc. in which various information and programs are stored, and a processing unit and an information input device 90 that perform various processes by executing the program are networked. It has a communication unit and the like that are connected to the device and control so that communication with other devices connected to the network can be performed.
  • a web browser function can be made to function, or an information transmission / reception function such as an e-mail can be made to function.
  • the user of the information input device 90 can browse the information received from another device connected to the network, or cause the information input device 90 to transmit the information to the other device. Can be done.
  • the camera unit 80 has a jig 87 to which the camera 81 is attached and which the user (detection worker) can grasp by hand.
  • the jig 87 is a part of the camera unit 80 other than the camera 81.
  • the jig 87 has an arm portion 88 for submerging and holding the camera 81 in water.
  • the shape and configuration of the jig 87 are not limited to this. Further, a configuration in which the camera 81 is suspended via a wire or the like may be adopted.
  • the user goes to the fish cage P where the fish to be detected is located, and uses the terminal device 60 and the camera unit 80 connected to the terminal device 60 to perform the detection work on the fish in the fish cage P. ..
  • the aquatic animal detection system 1 exchanges information as follows. That is, the image taken by the camera 81 and the information acquired by the camera unit 80 are input to the terminal device 60.
  • the terminal device 60 transmits information such as an image (for example, information such as an image, sensor measurement information, and position information, but is not limited to this) to the information processing device 10 via a network.
  • the information input device 90 includes various input data (for example, information on fish species, growing days, feeding amount, weather history, water quality history, etc., but is not limited to this). Is transmitted to the information processing device 10.
  • the information processing device 10 performs detection processing, determination processing related to the growth state, and the like as described later, and information indicating the results (information such as fish size, weight, notification information, determination result, etc.) (Not limited) is transmitted to the terminal device 60.
  • the terminal device 60 can receive the transmitted information and output it to the user.
  • FIG. 2 is a block diagram of the aquatic animal detection system 1.
  • FIG. 3 is a block diagram of the information processing apparatus 10.
  • the information processing device 10 includes a receiving unit 18, a transmitting unit (an example of a notification output unit) 19, a storage unit 21, and a processing unit 30.
  • the receiving unit 18 and the transmitting unit 19 connect the information processing device 10 to the network and perform communication with other devices connected to the network.
  • the receiving unit 18 and the transmitting unit 19 may be configured to perform wireless communication using, for example, wireless LAN or data communication of a mobile phone, or may be configured to perform various types of wired communication. May be good.
  • the receiving unit 18 receives the information transmitted from the other device.
  • the receiving unit 18 stores the received information in, for example, the storage unit 21 or hands it over to the processing performed by the processing unit 30.
  • the transmission unit 19 transmits information to another device.
  • the transmission unit 19 transmits, for example, the information stored in the storage unit 21 or the information delivered from the processing unit 30.
  • the transmission unit 19 functions as, for example, a notification output unit that transmits the notification information generated by the notification generation unit 36 as described later.
  • the storage unit 21 is realized by a non-volatile recording medium, it can also be realized by a volatile recording medium.
  • Information acquired by each part of the processing unit 30 as described later is stored in each part of the storage unit 21, but the process of storing information or the like in each part of the storage part 21 is not limited to this. ..
  • information or the like may be stored in the storage unit 21 via a recording medium, or information or the like transmitted via a communication line or the like may be stored in the storage unit 21.
  • the information or the like input via the input device may be stored in the storage unit 21.
  • the storage unit 21 includes a notification condition storage unit 22 and a second notification condition storage unit 23.
  • Notification conditions are stored in the notification condition storage unit 22.
  • the notification condition is used when determining whether or not to notify the user performing the detection work regarding the detection work when the detection work is executed.
  • Notification conditions are set in advance. It may be set prior to the user's detection work, may be set by being specified by the user at the start of the detection work or during the work, or may be set based on the information acquired by the information processing apparatus 10. It may be set automatically.
  • the notification condition includes a condition relating to the progress of detection of aquatic animals.
  • the notification condition includes a condition relating to the total number of aquatic animals (detected number) detected by the detection operation.
  • the notification conditions include the degree of achievement of the current detection number with respect to the final achievement value of the detection number (when the detection number 100 is set as a goal, the current detection number is 10%, 20%, and so on. It may be (such as what has been achieved). For example, when performing detection work for the purpose of measuring the size of aquatic animals growing in one cage, if the number of detections exceeds a predetermined number, it is statistically effective in expressing the size of aquatic animals. If an average value is obtained, the number can be set as a notification condition.
  • a measurement result having a predetermined confidence interval for example, a section of 3 sigma
  • a value such as a standard deviation calculated using the measured value may be calculated at any time according to the progress of the aquatic animal detection work (for example, it may be calculated by the detection processing unit 31 described later) and set as a notification condition. ..
  • the notification condition may include a condition relating to the positional relationship between the camera 81 and the aquatic animal detected from the image.
  • the positional relationship is, for example, the orientation of the camera 81 with respect to the posture of the aquatic animal (for example, the orientation of the aquatic animal which is a fish), the distance between the aquatic animal and the camera 81, and the like, but is not limited thereto. ..
  • the second notification condition is stored in the second notification condition storage unit 23.
  • the second notification condition is a condition related to the measurement result of aquatic animals, which is performed at the time of executing the detection work, as described later. That is, the second notification condition is, for example, the size of an aquatic animal (fish body length (the length from the tip to the rear end of the tail fin, but may be defined differently)) and the fish body height (dorsal side). The size of the fish from to the ventral side, but may have a different definition), the width of the fish (the width between both sides of the fish, but may have a different definition), It is a predetermined threshold value or the like defined for the measurement result of body weight (weight), etc.
  • the second notification condition is not limited to these. For example, in the detection operation, when a measurement result is obtained for an arbitrary feature amount related to the size of the fish body (for example, the degree of hanging of the aquatic animal's belly, the form of the aquatic animal, etc.) It may be set.
  • the storage unit 21 includes a biological information storage unit 24, a model information storage unit 25, a feeding information storage unit 26, a growth plan information storage unit 27, and a shipping standard information storage unit 28.
  • the biological information is stored in the biological information storage unit 24.
  • the biological information is information acquired by the biological information acquisition unit 42, as will be described later. That is, the biological information is information acquired based on the image, and may be a measured value of the aquatic animal detected in the detection work or an arbitrary feature amount related to the size of the fish body, or in the detection work. The information may be obtained based on the number of detected aquatic animals and the like.
  • Model information is stored in the model information storage unit 25.
  • the model information is a reference value for the growth of aquatic animals.
  • the model information includes, for example, the transition of time for aquatic animals (for example, the number of growth (for example, DOC (Day of Culture; the number of days of growth since the fry was placed in the cage for aquaculture)), the number of days elapsed after hatching, and the like. ) And an index showing the growth of the body. More specifically, for example, for a fish, it means a value in which the DOC is associated with a standard fish body length, average weight, and the like.
  • the reference value may be summarized in a table, or may be a growth curve represented by, for example, a mathematical formula. Note that the model information is not limited to such an existing growth curve model.
  • a known growth curve model may be a growth curve model corrected by utilizing the time-series biological information stored in the biological information storage unit 24.
  • the model information may be the environment of the cage. (For example, it may be prepared according to the water temperature and water quality (oxygen concentration, pH, etc.).
  • Feeding information is stored in the feeding information storage unit 26.
  • the feeding information is information on feeding to the cage, and more specifically, for example, information such as the time of feeding and the amount of feeding (feeding start / end time, daily feeding amount, monthly feeding amount). , Feeding interval, etc.).
  • the feeding information may also include, for example, an identifier that identifies the fed feed, information on the properties of the feed (pellet size, fishmeal content, etc.), and the like.
  • the growth plan information storage unit 27 stores growth plan information indicating a preset growth plan.
  • the growth plan information is, for example, a target value of an index indicating the growth of the body, which is associated with the transition of time for aquatic animals.
  • the growth plan information can be set, for example, in the model information based on the characteristics of the aquatic animal as a seedling, the characteristics of the environment of the cage, and the like, but is not limited to this.
  • the growth plan information may be set based on, for example, the time and size of aquatic animals expected to be shipped.
  • the shipping standard information storage unit 28 stores shipping standard information indicating a preset shipping standard.
  • the shipping standard information is information indicating the shipping standard, and is, for example, information indicating the size, weight, sales time, etc. requested by the shipping destination (sales destination) of the aquatic animal, but is not limited to this.
  • the processing unit 30 includes a detection processing unit 31 and an information processing unit 40.
  • the processing unit 30 controls the operation of the information processing device 10 and performs processing in cooperation with the terminal device 60 and the like. Coordination with a device connected via a network, such as the terminal device 60, can be performed by transmitting a command to each device, receiving information from each device, and the like.
  • the processing unit 30 can usually be realized from an MPU, a memory, or the like.
  • the processing procedure of the processing unit 30 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).
  • the detection processing unit 31 mainly performs processing related to the detection work.
  • the detection processing unit 31 includes an image acquisition unit 32, a detection unit 33, a measurement unit 34, a notification determination unit 35, and a notification generation unit 36.
  • the measuring unit 34 is included in the detecting unit 33, but the present invention is not limited to this.
  • the image acquisition unit 32 acquires an image taken by the camera 81.
  • the image is immediately transmitted to the information processing device 10 via the terminal device 60 after being taken by the camera 81. That is, the image acquisition unit 32 immediately acquires the image taken by the camera 81.
  • "immediate” does not necessarily mean that the time difference is extremely small, and may include some delay time and time for processing such as communication and image processing.
  • the image taken by the camera 81 does not have to be immediately transmitted to the information processing device 10, and is, for example, periodically (intervals of several seconds, minutes, hours, etc.) or a predetermined event.
  • the image may be transmitted to the information processing device 10 at the timing when the occurrence is detected by the terminal device 60 or the like.
  • the detection unit 33 detects the aquatic animals shown in the image.
  • the detection unit 33 detects aquatic animals immediately after the image is taken.
  • the detection unit 33 reads out the image immediately acquired from the shooting by the image acquisition unit 32, and immediately detects the aquatic animal.
  • the detection of an individual aquatic animal by the detection unit 33 can be performed by various known methods.
  • the detection unit 33 extracts the contour of the object included in the image acquired by the image acquisition unit 32, compares the extracted contour with the contour information prepared in advance, and has a degree of similarity with the contour information of the aquatic organism. When is higher than a predetermined value, it can be determined that the object whose contour is extracted is an aquatic animal.
  • the detection unit 33 inputs a region image including an object included in the image acquired by the image acquisition unit 32, and outputs information indicating whether or not the object is an aquatic animal for machine learning.
  • a learning device constructed by the method may be used to detect whether or not the object included in the image is an aquatic animal.
  • the detection unit 33 has a measurement unit 34.
  • the measuring unit 34 measures the aquatic organisms shown in the image. In the present embodiment, the measuring unit 34 measures the size of an individual aquatic animal detected from an image by the detecting unit.
  • the measuring unit 34 measures, for example, the length of the fish, but the present invention is not limited to this. For individual aquatic animals, in addition to the length of the fish, various dimensions such as the height of the fish and the width of the fish may be measured, or any one of them may be measured. In addition, the measuring unit 34 may acquire the weight of the aquatic animal based on the measured measured value.
  • the body weight is determined by, for example, using table information in which the measured value and the body weight are associated in advance (for example, it may be stored in the storage unit 21), or shows the relationship between the measured value and the body weight. It can be obtained by calculating using a function or by acquiring using a learner configured by a machine learning method in advance. In the present embodiment, the fact that the measuring unit 34 acquires the body weight in this way can be said to measure the body weight. Further, the measuring unit 34 may acquire, for example, an arbitrary feature amount related to the size of the fish body (for example, the degree of hanging of the belly of the aquatic animal, the form of the aquatic animal, etc.). The size of such aquatic animals can be measured by various known methods.
  • the measuring unit 34 may measure the dimensions based on the distance between a plurality of predetermined feature points detected for the object determined to be an aquatic animal as described above and the position of the feature points. Further, for example, the measuring unit uses a learning device configured to input an image of an area in which an object determined to be an aquatic organism is present and output a feature amount related to the size of the aquatic organism, and to obtain a measurement result. May be obtained.
  • the detection of aquatic animals is a concept including the detection of individual aquatic animals and the measurement of the size of the detected individuals.
  • the detection unit 33 detects an individual aquatic animal in the image
  • the measurement unit 34 measures the detected individual.
  • the detection and measurement of another individual are performed.
  • the detection of aquatic animals may be regarded as a concept that does not include the measurement of the size of individual aquatic animals. In this case, it can be said that the detection processing unit 31 detects the aquatic animal by the detection unit 33 and measures the size of the aquatic animal by the measurement unit 34.
  • the notification determination unit 35 determines whether or not the notification condition regarding the detection status of aquatic animals by the detection unit 33 is satisfied.
  • the detection status of aquatic animals is, for example, the number of detected aquatic animals when the detection of aquatic animals is started for one cage P. That is, for example, when the notification condition storage unit 22 is set as the notification condition that the number of detected animals has reached a predetermined number as described above, the notification determination unit 35 determines that the number of detected aquatic animals is increased. Determine if the notification conditions are met. When the number of detected aquatic animals reaches a predetermined number, the notification determination unit 35 determines that the notification condition is satisfied.
  • the notification determination unit 35 acquires information indicating the positional relationship as the detection status of the detection unit 33 and notifies the notification. It may be determined whether or not the conditions are met.
  • the detection status of aquatic animals may be, for example, the physical condition and activity amount of the detected individual.
  • items related to the physical condition and activity amount of the detected individual may be set as notification conditions. ..
  • the physical condition and amount of activity of aquatic animals can be detected, for example, by detecting changes in the movement of the individual photographed at a predetermined time from the image. That is, in two or more images or moving images taken within a predetermined time, the distance traveled, the amount of change in posture, and the like are detected for one detected individual.
  • the body length and activity amount of the individual can be detected depending on whether or not the detected value exceeds a predetermined threshold value.
  • the detection method is not limited to this.
  • the notification determination unit 35 determines whether or not the second notification condition regarding the measurement result by the measurement unit 34 is satisfied. For example, when it is set as the second notification condition that the fish body length of the aquatic animal reaches a predetermined threshold value, the notification determination unit 35 determines whether or not the measured value of the individual aquatic animal has reached the predetermined threshold value. To judge. Then, when the measured value reaches a predetermined threshold value, the notification determination unit 35 determines that the second notification condition is satisfied. When a predetermined threshold value regarding the size of the aquatic animal is set as the second notification condition, the notification determination unit 35 compares the average value of the measured values of the detected individuals with the predetermined threshold value. It may be determined whether or not the second notification condition is satisfied.
  • the notification determination unit 35 continuously determines that the measured value of each individual has reached a predetermined threshold value more than a predetermined number of times, or continuously determines that the measured value of each individual has reached a predetermined threshold value. If this happens, it may be determined that the second notification condition is satisfied.
  • the notification generation unit 36 generates notification information when the notification determination unit 35 determines that the notification conditions are satisfied.
  • the notification information is information for notifying the user.
  • the notification information generated by the notification generation unit 36 is transmitted (an example of output) to the terminal device 60 by the transmission unit 19.
  • the terminal device 60 gives a notification.
  • the user can receive a notification by outputting voice from the terminal device 60, generating vibration from the terminal device 60, or displaying information on the screen of the terminal device 60. ..
  • the notification information is, for example, information for notifying the user that the notification condition is satisfied. That is, the user can know that the notification condition is satisfied by performing the notification based on the notification information.
  • the notification information can be generated, for example, as follows. For example, a predetermined message text associated with the notification condition in advance may be generated as notification information, or a predetermined variable (indicated as "$ variable") related to the notification condition may be used to "" total "$ variable. A message such as "animal detection is completed" may be generated as notification information.
  • the notification generation unit 36 generates the second notification information when the notification determination unit 35 determines that the second notification condition is satisfied.
  • the second notification information like the notification information, is information for notifying the user, and is information transmitted by the transmission unit 19 to the terminal device 60.
  • the terminal device 60 gives a notification and the user can receive the notification in the same manner as when the notification information is transmitted.
  • the second notification information is information for notifying the user that the second notification condition is satisfied. That is, the user can know that the second notification condition is satisfied by performing the notification based on the second notification information.
  • the second notification information can be generated, for example, as follows. For example, a predetermined message sentence associated with the second notification condition in advance may be generated as the second notification information, or a predetermined variable (indicated as "$ variable") related to the second notification condition may be used to obtain ". A message such as "The average fish length is” $ variable "is centimeter" may be generated as the second notification information.
  • the above-mentioned second notification condition may be interpreted as being included in the notification condition, or the notification condition may be interpreted as being included in the second notification condition.
  • the notification information may be interpreted as including the second notification information or also serving as the second notification information.
  • the second notification information may be interpreted as also serving as notification information.
  • the notification given to the user from the terminal device 60 based on the notification information transmitted from the information processing device 10 is a notification that the size of aquatic animals of a predetermined number or more has reached a predetermined threshold value.
  • the notification information generated by the notification generation unit 36 can also be interpreted as the second notification information regarding the measured value of the size of the aquatic animal, and the notification condition in this case is the size of the aquatic animal. It can also be interpreted as including the second notification condition regarding the measured value.
  • the detection processing unit 31 constitutes the aquatic animal detection device 10D together with the notification condition storage unit 22 and the second notification condition storage unit 23 of the storage unit 21.
  • the information processing device 10 has the aquatic animal detection device 10D.
  • the information processing unit 40 performs processing based on the information obtained by the detection operation, as shown below.
  • the information processing unit 40 includes a status information acquisition unit 41, a biological information acquisition unit 42, a biological information storage unit 43, an unfinished cage determination unit 44, an unfinished cage information generation unit 45, a growth state determination unit 46, and A feeding instruction information generation unit 47 is provided.
  • the status information acquisition unit 41 acquires shooting status information regarding the shooting status of the image shot by the camera 81.
  • the shooting status information regarding the shooting status includes shooting time information regarding the time such as the time when the shooting was performed.
  • the shooting status information may include other information, and the information may be, for example, position information corresponding to the position of the camera 81 (that is, position information indicating the position of the cage P). It may be information indicating the weather or the like, or it may be environmental information such as information measured by an environmental sensor 84 provided in the camera unit 80 as described later.
  • the shooting status information may include information such as information for identifying the cage P to be photographed and information indicating the nature of the cage P.
  • the position information may be, for example, information acquired by the camera unit 80 or the terminal device 60 using a satellite-based positioning system (GPS) or the like, or information indicating a point such as an address specified in advance. It may be. Further, the position information may be information input by the user via, for example, the terminal device 60 or the information input device 90. For example, the position information is acquired based on the information input by the user to identify the cage P to be photographed, the information for identifying the cage P in advance, and the information associated with the position information of the cage P. You may do so.
  • GPS satellite-based positioning system
  • the information indicating the weather or the like may be, for example, information such as sunny or cloudy, or information indicating temperature, wind speed, weather, precipitation, solar radiation, wave height, or the like.
  • Environmental information includes, for example, information on water temperature, oxygen, ammonia, nitrate, nitrite, carbon dioxide, seawater color and turbidity, concentration of biological quantities such as plankton, and other matters related to water quality. It is not limited to this.
  • the information that identifies the cage P is, for example, a cage identifier that can identify the cage P.
  • the information indicating the nature of the cage P includes, for example, information for identifying the seeds and seedlings of the aquatic animals being raised (fish species, seedling information, etc.), information on the breeding period, information on the number of fish at the start of growth, and information.
  • Various information such as information indicating the size of the cage P may be applicable.
  • the status information acquisition unit 41 may be able to acquire such shooting status information from, for example, input data transmitted from the information input device 90. In this case, it can be said that the information input by the user in the information input device 90 is acquired as the shooting status information. Further, the status information acquisition unit 41 may be able to acquire shooting status information from the information transmitted from the terminal device 60. In this case, the information automatically acquired by the terminal device 60 (for example, the information sent from the camera unit 80 to the terminal device 60) and the information input by the user in the terminal device 60 are acquired as shooting status information. It can be said that.
  • the status information acquisition unit 41 may acquire shooting status information including feeding information.
  • the feeding information is, for example, information on the feeding work performed on the photographed aquatic animal.
  • the feeding information included in the acquired shooting status information is stored in, for example, the feeding information storage unit 26.
  • the biological information acquisition unit 42 acquires biological information related to aquatic animals detected by the detection unit 33.
  • the biological information is acquired by the detection unit 33 based on the image.
  • the information may be obtained based on the number of aquatic animals detected by the detection unit 33, or may be a measured value of the size of the aquatic animal.
  • the biological information storage unit 43 stores the biological information acquired by the biological information acquisition unit 42 in the biological information storage unit 24 in association with the shooting status information.
  • the biological information is at least associated with, for example, the cage identifier indicating the cage P in which the image corresponding to the biological information was captured, and the imaging time information.
  • time-series biological information is configured in the biological information acquisition unit 42. That is, the time-series biological information is biological information detected by the detection operation at a plurality of past time points.
  • the time-series biological information may include the time-series growth history information and the information thereof.
  • the time-series growth history information is information in which determination results (details will be described later) regarding the growth state of aquatic animals by the growth state determination unit 46 at a plurality of past time points are accumulated.
  • the unfinished cage determination unit 44 determines whether or not the aquatic animal detection work has been performed for each cage P at one detection opportunity.
  • one detection opportunity means an opportunity for collectively performing detection work on a plurality of cages P.
  • detection opportunity information in which the date on which the detection work is performed and the cage identifier of the cage P to perform the detection work are associated with each other is stored in the storage unit 21 or the like.
  • the unfinished cage determination unit 44 refers to, for example, the detection opportunity information and extracts the cage identifier associated with the day when one detection operation is performed.
  • the unfinished cage determination unit 44 extracts the cage identifier corresponding to the biological information that is determined to be the same day information based on the shooting time information from the biological information stored in the biological information storage unit 24. Then, the unfinished cage determination unit 44 compares the two cage identifiers with each other, and determines that the fish cage P from which the cage identifier corresponding to the biological information has been extracted has been detected for aquatic animals at one detection opportunity. It is determined that the cage P from which the cage identifier corresponding to the biological information has not been extracted is an unfinished cage in which the aquatic animal detection work has not been performed (the detection work has not been completed). That is, the unfinished cage determination unit 44 determines whether or not the cage is an unfinished cage for each cage P based on the cage identifier and the photographing time information corresponding to the biological information stored in the biological information storage unit 24.
  • the unfinished cage information generation unit 45 generates unfinished cage information for identifying the unfinished cage when there is an unfinished cage determined by the unfinished cage determination unit 44 that the detection operation has not been performed.
  • the unfinished cage information includes a cage identifier that identifies the unfinished cage.
  • the transmission unit 19 transmits the unfinished cage information to the terminal device 60.
  • the unfinished cage information is transmitted to the terminal device 60, for example, the information is displayed on the screen of the terminal device 60, and the user can be notified. The user can know that there is an unfinished cage and information on the unfinished cage by being notified based on the unfinished cage information.
  • the unfinished cage information may include position information indicating the position of the unfinished cage. In that case, the terminal device 60 displays the information indicating the position of the unfinished cage, so that the user can more easily know the location of the unfinished cage.
  • the growth state determination unit 46 determines the growth state of aquatic animals based on the biological information accumulated by the biological information storage unit 43 as follows. As a determination regarding the growth state, various things may be performed. For example, the determination regarding the growth state includes, but is not limited to, determination of whether or not the aquatic animal is growing smoothly, and determination of whether or not there is a growth abnormality. For example, whether or not the aquatic animals have grown to a level suitable for shipping (that is, whether or not they meet the shipping standards) and whether or not the feeding conditions for the aquatic animals are appropriate, as described later. It may mean a judgment about.
  • the time-series biological information accumulated by the biological information storage unit 43 may be used, or only the biological information at one time point may be used.
  • the growth state determination unit 46 determines the growth state of the aquatic animal for each cage P.
  • the determination result of such a growth state may be transmitted by the transmission unit 19 to another device such as the terminal device 60.
  • the determination result is transmitted to the terminal device 60 or the like, the user can obtain information on the growth state of the aquatic animal through the terminal device 60 or the like.
  • the growth state determination unit 46 is in an abnormal state of growth of aquatic animals based on the biological information and the feeding information stored in the feeding information storage unit 26 (growth abnormality). It may be determined whether or not.
  • the determination by the growth state determination unit 46 may be performed based on, for example, the model information stored in the model information storage unit 25. That is, the growth state determination unit 46 can compare the growth process of the aquatic animal obtained from the time-series biological information with the model information and determine whether or not the growth is slow.
  • the growth state determination unit 46 may make a determination regarding the growth state based on the growth plan information stored in the growth plan information storage unit 27. That is, the growth state determination unit 46 may determine whether or not the size has reached the size expected as the growth state in the growth plan information.
  • the growth state determination unit 46 determines whether or not the growth state of the aquatic animal satisfies the shipping standard based on the biological information and the shipping standard information stored in the shipping standard information storage unit 28. You may. For example, when the fish length and sales time of aquatic animals are specified as the shipping standard, the growth state determination unit 46 reaches the fish length specified in the shipping standard for biological information at the sales time. When it is, it can be determined that it can be shipped.
  • the feeding instruction information generation unit 47 generates feeding instruction information regarding the feeding work to be performed on the aquatic animal based on the determination result regarding the growth state of the aquatic animal by the growth state determination unit 46.
  • the feeding instruction information includes, for example, information such as the feeding time and the amount of feed.
  • the feeding instruction information may also include, for example, an identifier that identifies the feed to be fed.
  • the feeding instruction information generation unit 47 determines. Generate feeding instruction information so that the growth of aquatic animals is promoted more than usual. Specifically, for example, the time at which feeding is performed so that the amount of one feeding is increased more than usual (for example, the standard feeding amount stored in the storage unit 21 in advance) or the frequency of feeding is increased. Set.
  • feeding instruction information is generated so that the growth of the aquatic animal is slower than usual. Specifically, for example, the time for feeding is set so that the amount of feeding at one time is reduced more than usual or the frequency of feeding is reduced. The generation of feeding instruction information is not limited to this.
  • the feeding instruction information is generated by the feeding instruction information generation unit 47
  • the feeding instruction information is stored in, for example, the storage unit 21.
  • the user can perform appropriate feeding according to the growing condition.
  • the feeding instruction information may be transmitted to the terminal device 60 by the transmission unit 19.
  • the user can receive information on feeding through the terminal device 60.
  • the terminal device 60 includes a terminal operation reception unit 61, a terminal output unit 62, a terminal transmission unit 64, a terminal reception unit 65, a terminal input unit 66, a terminal storage unit 71, and a terminal processing unit 73. Be prepared.
  • the terminal device 60 is, for example, an information terminal device that can be handled by a user who performs the detection work at a place where the detection work is performed (such as on a ship).
  • the terminal device 60 is, for example, a general tablet terminal and has a display device provided with a touch panel, but the terminal device 60 is not limited thereto.
  • the terminal device 2 can be connected to the network and is configured to be able to communicate with other devices connected to the network.
  • the terminal operation reception unit 61 receives information input by the user in response to the operation by the user.
  • the terminal output unit 62 has, for example, a terminal display unit 63 which is a display device.
  • the terminal output unit 62 outputs information by displaying the information on the terminal display unit 63, for example.
  • the information output method is not limited to this, and may be performed by outputting voice or the like from a speaker or the like. Further, the terminal output unit 62 may output by vibrating a vibration generating device or the like.
  • the terminal output unit 62 can read, for example, the information stored in the terminal storage unit 71 and output it.
  • the terminal display unit 63 can immediately display the image taken by the camera 81.
  • the terminal transmitter 64 is usually realized by a wireless or wired communication means, but may be realized by a broadcasting means.
  • the terminal transmission unit 64 reads the transmission information configured by the terminal configuration unit 75 from the terminal storage unit 71 or the like and transmits the transmission information.
  • the terminal transmission unit 64 transmits, for example, transmission information including information input from the camera unit 80.
  • the terminal receiving unit 65 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.
  • the terminal receiving unit 65 receives the information transmitted from the information processing device 10 and other devices via the network.
  • the terminal receiving unit 65 stores the received information in, for example, the terminal storage unit 71 so that the terminal processing unit 73 or the like can acquire the received information.
  • the terminal receiving unit 65 receives the notification information and the second notification information generated by the notification generation unit 36.
  • the terminal input unit 66 is an interface that is connected to an external device such as the camera unit 80 and controls the input of information output from the connected external device to the terminal device 60.
  • the terminal input unit 66 stores the input information in, for example, the terminal storage unit 71 so that the terminal processing unit 73 or the like can acquire it.
  • the terminal input unit 66 is composed of, for example, a connection terminal and a signal processing device conforming to a predetermined standard.
  • the terminal input unit 66 does not enable connection with an external device by wire, but may enable connection with an external device wirelessly. Further, the terminal input unit 66 may output information to an external device to enable bidirectional communication.
  • a non-volatile recording medium is suitable for the terminal storage unit 71, but a volatile recording medium can also be used.
  • Various information, programs, and the like are stored in the terminal storage unit 71. The process in which such information is stored does not matter.
  • the information may be stored in the terminal storage unit 71 via the recording medium, or the information transmitted via the communication line or the like may be stored in the terminal storage unit 71.
  • the information input via the input device may be stored in the terminal storage unit 71.
  • the terminal storage unit 71 has a position information storage unit 72.
  • the position information storage unit 72 stores position information indicating the position of the terminal device 60.
  • the position information is stored, for example, information acquired at any time by a position sensor (not shown) provided in the terminal device 60, but is not limited thereto.
  • it may be the position information input by the user, or the position information transmitted from an external device such as the camera unit 80.
  • the terminal processing unit 73 includes a terminal acquisition unit 74, a terminal configuration unit 75, and a terminal notification unit 76.
  • the terminal processing unit 73 can usually be realized from an MPU, a memory, or the like.
  • the processing procedure of the terminal processing unit 73 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).
  • the terminal acquisition unit 74 acquires the information stored in the terminal storage unit 71 in order to execute the processing by the terminal processing unit 73.
  • the terminal acquisition unit 74 may acquire information input or transmitted to the terminal device 60.
  • the terminal configuration unit 75 configures transmission information in which the information input from the camera unit 80, the position information stored in the position information storage unit 72, and the identifier that identifies the camera 81 or the terminal device 60 are associated with each other. To do.
  • the configured transmission information is transmitted to, for example, the information processing device 10 by the terminal transmission unit 64.
  • the terminal notification unit 76 When the notification information or the like transmitted from the information processing device 10 is received by the terminal receiving unit 65, the terminal notification unit 76 causes the terminal output unit 62 to output the information according to the notification information or the like. That is, the terminal notification unit 76 notifies the user regarding the detection status of aquatic animals based on the notification information acquired by the terminal reception unit 65.
  • the terminal notification unit 76 may notify the terminal output unit 62 by outputting voice, or may cause the terminal output unit 62 to output vibration. Further, the notification may be performed by using a plurality of means such as display on the terminal display unit 63, output of voice, and generation of vibration. By performing such a notification from the terminal output unit 62, the user can receive a notification regarding the detection status of aquatic animals and the like.
  • the camera unit 80 includes a camera 81, an environment sensor 84, and a camera output unit 85.
  • the camera 81 is, for example, a stereo camera.
  • the camera 81 is located at a position separated from each other, and includes a first image pickup unit 82 and a second image pickup unit 83, each of which has an image pickup element that receives light.
  • the camera 81 can capture a stereo image by capturing an image with each of the first imaging unit 82 and the second imaging unit 83.
  • the camera 81 is submerged in water and can take an underwater image of the cage P.
  • the camera 81 is not limited to a stereo camera. Further, the camera 81 may, for example, capture an image generated based on the result of transmitting and receiving ultrasonic waves, radio waves, and the like.
  • the environment sensor 84 is attached to the jig 87 together with the camera 81, for example.
  • the environment sensor 84 is submerged in the water of the raw sardine P, for example, to detect water temperature, oxygen, ammonia, nitrate, nitrite, carbon dioxide concentration, and other matters related to water quality.
  • the camera output unit 85 is, for example, an interface that controls the output of information to an external device to which the camera unit 80 is connected.
  • the camera output unit 85 can output the image obtained by the camera 81 and the information detected by the environment sensor 84 to an external device. In the present embodiment, the camera output unit 85 outputs this information to the terminal device 60 to which the camera unit 80 is connected.
  • the camera output unit 85 is composed of, for example, a connection terminal and a signal processing device conforming to a predetermined standard.
  • the camera output unit 85 does not enable connection with an external device by wire, but may enable connection with an external device wirelessly. Further, the camera output unit 85 may output information to an external device to enable bidirectional communication.
  • FIG. 4 is a perspective view showing an example of the camera 81.
  • FIG. 4 shows the posture of the camera 81 in a normal use state so that the top and bottom on the paper surface coincide with the top and bottom in water, but the posture of the camera 81 is not limited to this. Absent.
  • the first imaging unit 82 and the second imaging unit 83 are vertically separated from each other by a predetermined distance. This makes it possible to measure the dimensions of aquatic animals in the cage P with relatively high accuracy based on the captured image.
  • the first imaging unit 82 and the second imaging unit 83 may be separated from each other in the horizontal direction (direction substantially perpendicular to the vertical direction).
  • the optical axes of both imaging units 82 and 83 are substantially parallel to each other, but are not limited to this.
  • the camera 81 has a housing having a streamlined shape in which a cross section substantially perpendicular to the vertical direction forms a symmetrical wing shape having strings substantially parallel to the optical axes of the imaging units 82 and 83. doing. That is, the housing of the camera 81 has a shape that is relatively less susceptible to drag against the flow parallel to the optical axes of the imaging units 82 and 83.
  • FIG. 5 is a diagram illustrating a detection operation using the camera 81.
  • FIG. 5 a view of the cage P viewed from above is schematically shown.
  • the cage P is, for example, an area surrounded by a rectangular constituent member P1.
  • a large number of aquatic animals are swimming inside the cage P.
  • each aquatic animal orbits in the same direction on a circumferential path when viewed from above (indicated by a broken line arrow in the figure). Therefore, inside the cage P, a water flow that flows outward in the radial direction is generated from the circumferential path (indicated by a solid arrow in the figure).
  • the user inserts the camera 81 outside the path around which the aquatic animals orbit when performing the detection work on such a cage P.
  • the user since there is a water flow flowing outward in the radial direction, the user can easily maintain the camera 81 in a posture in which the optical axes of the imaging units 82 and 83 are substantially parallel in the radial direction.
  • the detection work can be performed with high accuracy.
  • FIG. 6 is a flowchart illustrating an example of the operation of the information processing device 10.
  • the information processing apparatus 10 performs a detection operation related to the detection work performed by the user and a determination operation for determining the growth state of the cage P, for example, as follows.
  • Step S101 the processing unit 30 determines whether or not the work of one detection opportunity has been started. For example, when there is information input from a user or the like instructing that it is a detection opportunity, or when the time is predetermined as a detection opportunity, the processing unit 30 states that the work of one detection opportunity has been started. to decide. If it is determined that the work of one detection opportunity has been started, the process proceeds to step S102, and if not, the process proceeds to step S103.
  • Step S102 The processing unit 30 performs an operation at the time of detection.
  • the operation at the time of detection will be described later.
  • Step S103 The processing unit 30 determines whether or not to start determining the growth state. For example, when there is an information input from a user or the like instructing to start the determination of the growth state, or when the time specified as the determination timing of the growth state arrives in advance, the processing unit 30 determines the growth state. Judge to start. If it is determined that the determination of the growth state is to be started, the process proceeds to step S104, and if not, the process returns to step S101.
  • Step S104 The growth state determination unit 46 sets 1 to the counter k.
  • Step S105 The growth state determination unit 46 determines whether or not there is a k-th cage P to be determined. If there is a k-th cage P to be determined, the process proceeds to step S106, and if not, the process returns to step S101.
  • Step S106 The growth state determination unit 46 performs an operation at the time of determination with respect to the kth cage P. The operation at the time of determination will be described later.
  • Step S107 The growth state determination unit 46 increments the counter k by 1 and returns to step S105.
  • FIG. 7 is a flowchart showing an example of the operation at the time of detection.
  • Step S111 The detection processing unit 31 determines whether or not the detection work for one cage P has been started. For example, when there is an information input from a user or the like instructing to start detection, or when reception of transmission information including an image or the like transmitted from the terminal device 60 is started, the detection processing unit 31 is one. It is determined that the detection work for the cage P has started. At this time, the detection processing unit 31 starts the detection work based on, for example, the cage identifier that identifies the cage P on which the detection operation is performed, which is included in the information input by the user or the transmission information from the terminal device 60. It is possible to identify the cage P. If it is determined that the detection work for one cage P has been started, the process proceeds to step S112, and if not, the process proceeds to step S115.
  • Step S112 The status information acquisition unit 41 acquires shooting status information.
  • Step S113 The detection processing unit 31 performs detection processing. The detection process will be described later.
  • the biological information acquisition unit 42 acquires the biological information obtained in the detection process.
  • the biological information storage unit 43 stores the biological information acquired by the biological information acquisition unit 42 in the biological information storage unit 24 in association with the photographing status information.
  • Step S115 The unfinished cage determination unit 44 determines whether or not there is an unfinished cage. If there is an unfinished cage, the process proceeds to step S116, and if not, the process proceeds to step S117.
  • Step S116 The unfinished cage information generation unit 44 generates unfinished cage information.
  • the transmission unit 19 transmits the generated unfinished cage information to the terminal device 60. As a result, the user can know that there is an unfinished cage and its information.
  • Step S117 The detection processing unit 31 determines whether or not the detection work at one detection opportunity has been completed. For example, when there is an information input from a user or the like instructing to end the detection work, the detection processing unit 31 determines that the detection work has been completed. When there are no unfinished cages, the detection processing unit 31 may determine that the detection work has been completed. If it is determined that the detection work is completed, the process returns to the process of FIG. 6, and if not, the process returns to step S111.
  • FIG. 8 is a flowchart showing an example of the detection process.
  • Step S131 The detection processing unit 31 sets 1 in the counter i.
  • Step S132 The image acquisition unit 32 acquires an image taken by the camera 81.
  • Step S133 The detection unit 33 performs image recognition on the image and detects the fish body of the aquatic animal included in the image.
  • Step S134 The detection unit 33 determines whether or not a fish body has been detected in the image. If it is detected, the process proceeds to step S135, and if not, the process proceeds to step S139.
  • the measuring unit 34 measures the fish body length of the detected fish body (i-th fish body). The measurement unit 34 records the measurement result in the storage unit 21.
  • Step S136 The detection processing unit 31 increments the counter i by 1.
  • Step S137 The notification determination unit 35 determines whether or not the second notification condition is satisfied based on the second notification condition. If it is determined that the second notification condition is satisfied, the process proceeds to step S138, and if not, the process proceeds to step S139.
  • Step S138 The notification generation unit 36 generates the second notification information.
  • the second notification information is transmitted to the terminal device 60 by the transmission unit 19. As a result, the terminal device 60 is notified based on the second notification information.
  • Step S139 The notification determination unit 35 determines whether or not the notification condition is satisfied based on the notification condition. If it is determined that the notification condition is satisfied, the process proceeds to step S140, and if not, the process proceeds to step S141.
  • Step S140 The notification generation unit 36 generates notification information.
  • the notification information is transmitted to the terminal device 60 by the transmission unit 19. As a result, the terminal device 60 is notified based on the notification information.
  • Step S141 The detection processing unit 31 determines whether or not the detection of the cage P has been completed. For example, when there is an information input from a user or the like instructing to end the detection of the cage P, the detection processing unit 31 determines that the detection of the cage P has been completed. In addition, when the notification determination unit 35 determines that the notification condition is satisfied, or when a predetermined time has elapsed, it is automatically determined that the detection of the cage P has been completed by another trigger. You may. If it is determined that the detection of the cage P is completed, the process returns to the process of FIG. 7, and if not, the process returns to step S132.
  • FIG. 9 is a flowchart showing an example of the operation at the time of determination.
  • Step S151 The growth state determination unit 46 acquires time-series biological information about the kth cage P from the biological information storage unit 24.
  • Step S152 The growth state determination unit 46 acquires model information from the model information storage unit 25. In addition, the growth state determination unit 46 acquires feeding information from the feeding information storage unit 26.
  • Step S153 The growth state determination unit 46 determines whether or not the aquatic animal is normally growing in the cage P. The determination can be made based on, for example, the acquired biological information, the model information, and the feeding information. The determination may be made based on the acquired biological information and the feeding information, or the determination may be made based on the biological information and the model information. If it is determined that the product is growing normally, the process proceeds to step S155. If not, the process proceeds to step S154.
  • Step S154 The growth state determination unit 46 determines that the growth is abnormal.
  • the growth state determination unit 46 acquires the growth plan information from the growth plan information storage unit 27.
  • Step S156 The growth state determination unit 46 determines whether or not the growth state of the aquatic animal is progressing in light of the growth plan based on the growth plan information and the biological information. Then, the feeding instruction information generation unit 47 generates feeding instruction information as described above based on the determination result of the growth state determination unit 46.
  • Step S157 The growth state determination unit 46 acquires the shipping standard information stored in the shipping standard information storage unit 28.
  • Step S158 The growth state determination unit 46 determines whether or not the growth state of the aquatic animal satisfies the shipping standard based on the biological information and the shipping standard information. If the shipping standard is satisfied, the process proceeds to step S158, and if not, the process returns to the process of FIG.
  • Step S159 The growth state determination unit 46 determines that the aquatic animal of the kth cage P can be shipped. After that, the process returns to FIG.
  • FIG. 10 is a diagram illustrating an example of the operation of the biological information storage unit 43.
  • the transmission information transmitted from the terminal device 60 to the information processing device 10 does not have to include the cage identifier.
  • the transmission information includes position information indicating the position of the terminal device 60 that performs the detection work, and the fish cage identification process that identifies the fish cage P for which the detection work was performed based on the position information in the information processing device 10 is performed. It may be done.
  • each row (each record) of the table represented by the reference numeral D1 is an example of transmission information. That is, the transmission information corresponds to, for example, the shooting date and time, the position information, the detected values (for example, oxygen concentration, pH, and water temperature) detected by the environment sensor 84, and the image identifier that identifies the captured image. This is the attached information.
  • the table represented by the reference numeral D2 is the cage information in which the cage identifier and the position information of the cage P are associated with each of the plurality of cages P to be managed.
  • Such cage information may be stored in the storage unit 21 in advance, or may be transmitted from the information input device 90 or the like to the information processing device 10.
  • the processing unit 30 When such transmission information is transmitted from the terminal device 60, the processing unit 30 performs a cage identification process using the cage information indicated by reference numeral D2. That is, in the cage identification process, the processing unit 30 can acquire the cage identifier of the corresponding cage from the cage information based on the position information included in the transmission information and associate it with the transmission information. Further, by performing the detection process on the image, it is possible to obtain information such as the fish body length of the aquatic animal and associate it with the information included in the transmitted information.
  • Each row (each record) of the table indicated by the reference numeral D3 is an example of biological information and shooting status information associated therewith. That is, for example, the average body length, which is biological information, the shooting date and time, which is shooting time information, the cage identifier, the fish species, the weather, the water temperature, the number of growing days, and whether or not the water quality is normal, respectively.
  • the shooting status information of the above is associated with each other and stored in the biological information storage unit 24.
  • the fish species, the weather, and the number of growing days are associated with the cage identifier based on the information transmitted from the information input device 90, but the present invention is not limited to this.
  • the information indicating whether or not the water quality is normal is information generated by the processing unit 30 based on the measured value regarding the water quality included in the transmission information transmitted from the terminal device 60, but is limited to this. Absent.
  • various types of information for example, feeding information such as daily feeding amount
  • time-series biological information is accumulated for each cage P.
  • FIG. 11 is a diagram showing an example of time-series biological information stored in the biological information storage unit 24.
  • FIG. 11 shows an example of biological information about the cage P whose cage identifier is "AA003".
  • the biological information storage unit 43 stores the biological information in association with the shooting time information (for example, the shooting date and time) and the cage identifier. Therefore, it is possible to extract time-series biological information for each cage P by using the cage identifier as a key. From the time-series biological information, the growth process of aquatic organisms can be obtained for each cage P. By comparing such time-series biological information with, for example, model information, various determinations and evaluations can be made, such as whether or not the growth state of aquatic animals is appropriate.
  • FIG. 12 is a diagram showing an example of shipping standard information stored in the shipping standard information storage unit 28.
  • the shipping standard information includes, for example, a shipping destination, a desired delivery date (an example of information for specifying a shipping time), and a fish body length (an example of a shipping standard) as a standard for shipping. It is associated with an identifier. In addition to this information, information on fish species, order details, that is, an order identifier that specifies shipping conditions, and the like may be associated. Based on such shipping standard information and biological information, it is possible to determine whether or not the aquatic animal has grown to the extent that it satisfies the shipping standard for each cage P.
  • FIG. 13 is a table for explaining the operation of the feeding instruction information generation unit 47.
  • FIG. 13 shows in tabular form an example of information that determines the standard feeding amount used for generating feeding instruction information.
  • the daily feeding amount to be fed to a predetermined number of aquatic animals grown in the cage P is shown.
  • the amount of feed is determined according to the body weight of the aquatic animal and the water temperature.
  • the feeding instruction information generation unit 47 can obtain, for example, the standard feeding amount based on the information for determining the standard feeding amount thus determined, the detected biological information, the water temperature, and the like. Then, when the growth state of the aquatic animal is delayed or advanced in light of the growth plan, the feeding instruction information generation unit 47 instructs the feeding instruction to feed the feeding amount increased or decreased from the standard feeding amount. Information can be generated.
  • the processing unit 30 generates information for determining the standard feeding amount based on the time-series biological information including the photographing status information and the feeding information, or generates preset information. It may be corrected. Further, the processing unit 30 may generate model information or correct preset model information based on time-series biological information including shooting status information. Such information for determining the standard feeding amount and model information can be generated or corrected for each fish species, for each fish cage P, or for each area where the cage P is located. Such information for determining the standard feeding amount and model information can be specifically generated, for example, by analyzing biological information or the like by a statistical method. Further, the correction of the information for determining the standard feeding amount and the model information is performed, for example, by calculating the correction value for the existing information based on the comparison result between the obtained biological information and the existing information. Can be done.
  • FIG. 14 is a flowchart showing an example of an operation related to correction of model information by the processing unit 30.
  • the processing unit 30 can correct the model information as follows, for example.
  • Step S101 The processing unit 30 acquires time-series biological information about a predetermined fish species from the biological information storage unit 24.
  • Step S102 The processing unit 30 acquires the model information stored in the model information storage unit 25.
  • the processing unit 30 generates a correction value by comparing the acquired time-series biological information with the model information. Specifically, for example, for a specific fish species, the average value of biological information such as fish body length for a large number of cages P, and the average value of biological information such as fish body length at different growth opportunities having the same number of growing days. However, if it deviates from the average value of the fish body length specified by the model information by a predetermined threshold or more, a predetermined value is generated as a correction value. The generation of the correction value is not limited to this.
  • Step S104 The processing unit 30 updates the model information using the generated correction value. Further, the updated model information is stored in the model information storage unit 25 and used in the subsequent processing.
  • such information for determining the standard feeding amount and model information may be generated by using, for example, the above-mentioned machine learning method.
  • a learner configured with shooting status information as input information and biological information as output information can be used as model information.
  • a learning device configured with biological information including imaging status information as input information and feeding information corresponding to the biological information as output information can be used as information for outputting the feeding amount.
  • the feeding instruction information generation unit 47 can generate feeding instruction information that specifies a desirable feeding amount by inputting biological information including photographing status information into the learning device.
  • model information may be created. For example, it is possible to evaluate the relationship between the size of a fish, environmental data such as water temperature, and daily feeding amount, and create a relational expression and a correspondence table. As a result, it is possible to notify the appropriate s feeding amount in real time based on the measurement result regarding the size of the aquatic animal in real time and the acquired relational expression.
  • the user may check the image used for the detection, and exclude / modify the image that is considered to be unsuitable for the configuration of the learning device.
  • Another physiological characteristic of fish is that the growth rate changes according to age and maturity. The tendency of the growth curve depends on the seedlings and environmental conditions, but since the overall tendency is the same, the feature amount of the growth curve is extracted by using the actual data of the growth curve obtained by measuring the fish body length as input information. You may. In addition, by correcting the growth curve due to the results of existing biophysiology with model information obtained by utilizing time-series biological information, seedling characteristics and environmental characteristics peculiar to the application destination of the aquatic animal detection system 1 can be obtained. You may create a growth model that takes this into consideration. By calculating the growth curve of the fish body in this way, it is possible to recommend a guideline time when it is preferable to perform the next detection work.
  • the conventional aquatic animal detection device it may not be easy to perform work involving detection of aquatic animals in water. That is, it has been difficult for the user who performs the detection work to know on board the ship whether or not the detection work can be performed so that the detection result can be properly obtained.
  • the cameras used for the detection work are generally relatively large, and it is necessary to prepare large-scale equipment for the detection work itself.
  • the user can receive a notification regarding the detection work when a predetermined notification condition is satisfied. Therefore, since the user can quickly know whether or not the detection work for obtaining an appropriate detection result can be performed, the aquatic animal detection work can be easily performed.
  • the notification may be made, for example, by displaying the information on the terminal device 60. As a result, the user can receive the notification while viewing the image taken by the camera 81. Further, the notification may be performed, for example, by outputting voice or vibration from the terminal device 60. As a result, the user can receive the notification even if he / she is not paying attention to the screen of the terminal device 60.
  • notification is performed by outputting voice, vibration, light, or the like from a device that operates in cooperation with the terminal device 60 (for example, a camera unit 80 or a device such as a speaker that can communicate with the terminal device 60). You may.
  • the camera 81 used for the detection work can be a relatively small one. Further, the camera unit 80 can be miniaturized to such an extent that the user can grasp it by using the jig 87. Since the camera unit 80 and the terminal device 60 can be connected to perform the detection work on a ship or the like, the aquatic organism detection work can be easily performed. Further, since the user can be notified through such a terminal device 60, the user can be effectively notified. Since the camera 81 is small, it is difficult for aquatic animals to be alert and it is possible to take an effective picture. It also reduces the likelihood of damaging aquatic fish.
  • processing in this embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded on a recording medium such as a CD-ROM and disseminated.
  • the software that realizes the aquatic animal detection device 10D in the present embodiment can be the following program. That is, this program has an image acquisition step of acquiring an image taken by a camera on a computer, a detection step of detecting an aquatic animal appearing in an image taken by a camera, and a detection status of aquatic animals by the detection step. It is a program that executes a notification determination step for determining whether or not the notification condition is satisfied and a notification generation step for generating notification information when it is determined by the notification determination step that the notification condition is satisfied.
  • the information processing device 10 has been shown to function as the aquatic animal detection device 10D, but the present invention is not limited to this. Some of the functional blocks constituting the information processing device 10 may be provided in other devices constituting the aquatic animal detection system 1, and some of the functional blocks constituting the terminal device 60 may detect aquatic animals. It may be provided in other devices constituting the system 1.
  • FIG. 15 is a block diagram of the aquatic animal detection system 101 according to a modified example of the first embodiment.
  • FIG. 16 is a block diagram of the information processing apparatus 110.
  • the aquatic animal detection system 101 has an information processing device 110 and a terminal device 160 having different configurations from the information processing device 10 and the terminal device 60 of the first embodiment, respectively.
  • the terminal device 160 has a terminal storage unit 171 and a terminal processing unit 173.
  • the terminal storage unit is different from the terminal storage unit 71 in the first embodiment in that it further has a notification condition storage unit 22 and a second notification condition storage unit 23.
  • the terminal processing unit 173 is different from the terminal processing unit 73 in the first embodiment in that it has a detection processing unit 31. That is, the terminal device 160 has a aquatic animal detection device 160D configured in the same manner as the aquatic animal detection device 10D provided in the information processing device 10 in the first embodiment, as compared with the terminal device 60 in the first embodiment. It can be said that they differ in that they have.
  • the information processing device 110 has a storage unit 121 and a processing unit 130.
  • the storage unit 121 is different from the storage unit 21 in the first embodiment in that it does not have the notification condition storage unit 22 and the second notification condition storage unit 23.
  • the processing unit 130 is different from the processing unit 30 in the first embodiment in that it does not have the detection processing unit 31.
  • the aquatic animal detection system 101 configured in this way, by allowing the terminal device 160 and the information processing device 110 to appropriately transmit and receive information, the detection is roughly performed in the same manner as in the first embodiment. It is possible to perform time operation and judgment time operation.
  • the terminal device 160 that can be used at the hand of the user who performs the detection work near the cage P functions as the aquatic organism detection device 160D. That is, during the aquatic animal detection operation, the terminal device 160 detects the aquatic animal and outputs the notification information without transmitting an image from the terminal device 160 to the information processing device 110. At this time, it can be said that the terminal notification unit 76 of the terminal device 160 functions as a notification output unit that outputs notification information. For example, the notification information generated by the notification generation unit 36 is output to the terminal display unit 63 that displays the image captured by the camera 81.
  • the determination operation may be executed when the terminal device 160 and the information processing device 110 can communicate with each other.
  • the aquatic animal detection system 201 is configured so that the user can perform the detection work even in a remote environment by using the camera unit 280 installed in the cage P.
  • FIG. 17 is a schematic diagram of the aquatic animal detection system 201 according to the second embodiment of the present invention.
  • FIG. 18 is a block diagram of the aquatic animal detection system 201.
  • the aquatic animal detection system 201 includes an information processing device 10, a terminal device 60, a camera unit 280, and an information input device 90. Also in the present embodiment, the information processing device 10 also functions as the aquatic animal detection device 10D, but the present invention is not limited to this.
  • the information processing device 10, the terminal device 60, and the information input device 90 are configured in the same manner as in the first embodiment.
  • the camera unit 280 itself is configured to be connectable to a network, and is configured to be able to communicate with, for example, the information processing device 10. That is, the camera unit 280 includes a camera 281, a camera storage unit 282, a camera processing unit 283, a camera configuration unit 284, a camera transmitting unit 285, a camera receiving unit 286, and an environment sensor 84. ..
  • the camera 281 is a stereo camera having a first imaging unit 82 and a second imaging unit 83, similarly to the camera 81 of the first embodiment. As will be described later, the camera 281 has a housing having a shape different from that of the camera 81, but is not limited to this. That is, the camera 81 of the first embodiment may also be used in the camera unit 280.
  • the camera storage unit 282 is realized by a non-volatile recording medium, but it can also be realized by a volatile recording medium.
  • the camera storage unit 282 stores, for example, an image taken by the camera 281 and a measured value of the environment sensor 84 for transmission to an external device, but the present invention is not limited to this.
  • the camera processing unit 283 controls the operation of the camera unit 280 and performs processing in cooperation with the information processing device 10. Coordination with devices connected via a network, such as the information processing device 10 and the terminal device 60, can be performed by transmitting a command to each device or receiving information from each device. For example, when the camera receiving unit 286 receives the shooting control information transmitted from the information processing device 10 or the like, the camera processing unit 283 controls each unit of the camera unit 280 based on the shooting control information.
  • the shooting control information includes, for example, a shooting start or stop instruction, a camera 281 control instruction, a transmission information transmission instruction, a status information transmission instruction indicating the state of the camera unit 280, and the like, but is not limited thereto.
  • the camera processing unit 283 can usually be realized from an MPU, a memory, or the like.
  • the processing procedure of the camera processing unit 283 is usually realized by software, and the software is recorded in a recording medium such as ROM. However, it may be realized by hardware (dedicated circuit).
  • the camera configuration unit 284 is provided in the camera processing unit 283.
  • the camera configuration unit 284 is configured by associating the transmission information transmitted from the camera unit 280 to the information processing device 10 with an identifier that identifies the camera unit 280 or each unit thereof.
  • the transmission information includes, but is not limited to, for example, an image taken by the camera 281 and a measured value of the environment sensor 84.
  • the position information acquired by the environment sensor 84 using GPS or the like may be included in the transmission information.
  • the camera transmitting unit 285 and the camera receiving unit 286 connect the camera unit 280 to the network and perform communication with other devices connected to the network.
  • the camera transmitting unit 285 and the camera receiving unit 286 may be configured to perform wireless communication using, for example, wireless LAN or data communication of a mobile phone, or may be configured to perform various wired communications. You may be.
  • the camera transmission unit 285 transmits information to another device.
  • the camera transmission unit 285 transmits, for example, the information stored in the camera storage unit 282 or the information handed over from the camera processing unit 283.
  • the camera transmission unit 285 transmits the transmission information configured by the camera configuration unit 284 to the information processing device 10 and the like.
  • the camera receiving unit 286 receives information transmitted from another device.
  • the camera receiving unit 286 delivers the received information to, for example, the processing performed by the camera processing unit 283.
  • the camera receiving unit 286 receives the photographing control information transmitted from the information processing device 10 or the like.
  • the camera unit 280 itself is configured to be able to transmit transmission information including an image via a network in this way, so that the user can use the terminal, for example, as follows.
  • the device 60 can be used to detect the cage P from a remote location. Therefore, the detection work can be easily performed.
  • the user uses the terminal device 60 to transmit a shooting instruction or the like to the information processing device 10.
  • a shooting instruction or the like an identifier that identifies the camera unit 80 may be specified, or the cage identifier of the cage P may be specified.
  • a group of a plurality of cages P to be detected at one detection opportunity may be designated in advance, and a shooting instruction may be given by using an identifier or the like that specifies the group.
  • the information processing device 10 transmits shooting control information to the camera unit 80. Then, the camera unit 80 transmits the transmission information including the image to the information processing device 10.
  • the information processing device 10 receives the transmission information transmitted from the camera unit 80 and performs an operation at the time of detection. Further, the result is transmitted to the terminal device 60. If the notification condition is satisfied during the detection operation, the information processing device 10 outputs the notification information to the terminal device 60 to notify the user, as in the first embodiment. You may do so. As a result, the user can easily perform the detection operation as in the first embodiment.
  • FIG. 19 is a perspective view showing a schematic configuration of the camera unit 280.
  • the camera unit 280 has a jig 287 to which the camera 281 is attached.
  • the jig 287 has an arm portion 88 for submerging and holding the camera 281 in water, and a hook 89 hooked on a constituent member P1 constituting the cage P. That is, the camera unit 280 can hold the camera 281 in a predetermined position by hooking the hook 89 on a part of the constituent member P1 (for example, the upper end edge of the net that divides the cage P).
  • the shape and configuration of the jig 287 are not limited to this.
  • the camera unit 280 may be configured so that it can be attached to the constituent member P1 by using a wire or the like or by a method such as a spiral stopper.
  • the housing of the camera 281 has a flat shape in which the dimensions parallel to the optical axes of the imaging units 82 and 83 are relatively small. Therefore, the camera 281 can be arranged underwater so that the housing of the camera 281 is aligned with the component P1, and the position of the camera 281 can be stably held.
  • FIG. 20 is a perspective view showing an arrangement example of the camera 281.
  • the back surface of the housing of the camera 281 (the surface opposite to the surface of the photographing units 82 and 83 facing the direction of imaging) is, for example, the inner surface of the component P1 which is a net. It can be arranged along. As described above, in the cage P, the movement of the aquatic animal creates a radial flow of water, and the water flow pushes the camera 281 toward the component P1. Therefore, the position of the camera 281 is stable.
  • the camera 281 can be fixed in water without diving work. Further, since a plurality of camera units 280 installed for each cage can be integratedly managed, monitoring work of each cage P can be easily performed even if the number of cages P increases.
  • the aquatic animal detection system 301 is configured so that the feeding operation to the cage P can be automatically performed or the feeding operation can be performed by remote control by using the feeding device 600 installed in the cage P. Is.
  • FIG. 21 is a schematic view of the aquatic animal detection system 301 according to the third embodiment of the present invention.
  • FIG. 22 is a block diagram of the aquatic animal detection system 301.
  • the aquatic animal detection system 301 includes an information processing device 10, a terminal device 60, a camera unit 280, and an information input device 90, as in the second embodiment. Also in the present embodiment, the information processing device 10 also functions as the aquatic animal detection device 10D, but the present invention is not limited to this.
  • the aquatic animal detection system 301 further includes a feeding device 600 capable of communicating with, for example, an information processing device 10 via a network.
  • the feeding device 600 has the following components, and automatically supplies feed to the cage P.
  • the feeding device 600 includes a measuring unit (not shown) for measuring the feed, a spraying mechanism (not shown), and a driving unit (not shown) for driving the spraying mechanism and the like. ) Etc. Further, the feeding device 600 includes a feeding storage unit 601, a feeding processing unit 603, a feeding transmitting unit 605, and a feeding receiving unit 606. The feeding device 600 is arranged above the cage P, for example.
  • the measuring unit is a scale that measures the feed taken out from the feed tank 610.
  • the measuring unit can weigh a predetermined amount of feed and take it out from the feed tank 610 according to the control by the feed processing unit 603.
  • the spraying mechanism supplies the feed weighed by the measuring unit to the cage P.
  • the spraying mechanism has, for example, a rotatable arm member, and while the arm member is rotated by a drive unit that is an electric motor, the feed is sprinkled from the arm member so that the feed can be evenly sprayed on the cage P. It is configured in.
  • the supply unit for supplying the feed to the cage P is not limited to such a spraying mechanism, and known means can be widely used.
  • the feeding conditions include, for example, a condition relating to the feed timing and a condition relating to the feed amount.
  • a non-volatile recording medium is suitable for the feed storage unit 601, but a volatile recording medium can also be used.
  • the feeding instruction information transmitted from the information processing apparatus 10 is stored in the feeding storage unit 601 as the feeding condition (the feeding condition is set).
  • the process of storing the feeding conditions in the feeding storage unit 601 is not limited to this, and the user may set the feeding conditions based on the feeding instruction information.
  • the feeding conditions may be stored in the feeding storage unit 601 via the recording medium, and the feeding conditions transmitted from the terminal device 60 or the like may be stored in the feeding storage unit 601.
  • the feeding conditions input via the input device may be stored in the feeding storage unit 601.
  • the feeding processing unit 603 can usually be realized from an MPU, a memory, or the like.
  • the processing procedure of the feeding processing unit 603 is usually realized by software, and the software is recorded in a recording medium such as ROM. However, it may be realized by hardware (dedicated circuit).
  • the feed processing unit 603 supplies feed to the cage P based on the feeding conditions stored in the feed storage unit 601.
  • the feeding processing unit 603 records the feeding information (log; for example, information such as the feeding time and the feeding amount) when the feeding is actually performed.
  • the feeding processing unit 603 can transmit the recorded feeding information and the like to the information processing device 10 and the like by the feeding transmitting unit 605.
  • the feeding transmitting unit 605 and the feeding receiving unit 606 connect the feeding device 600 to the network and communicate with other devices connected to the network.
  • the feeding transmitting unit 605 and the feeding receiving unit 606 may be configured to perform wireless communication using, for example, wireless LAN or data communication of a mobile phone, or are configured to perform various wired communications. You may be.
  • the feeding transmission unit 605 transmits information to other devices.
  • the feeding transmission unit 605 transmits, for example, the information stored in the feeding storage unit 601 or the information handed over from the feeding processing unit 603.
  • the feeding transmission unit 605 transmits the feeding information indicating the feeding amount, the date and time, etc. of the feeding to the information processing device 10 or the like in association with the cage identifier of the cage P, the identifier that identifies the feeding device 600, or the like. To do.
  • the feeding receiving unit 606 receives information transmitted from another device.
  • the feeding receiving unit 606 stores the received information in, for example, the feeding storage unit 601 or delivers the received information to the processing performed by the feeding processing unit 603.
  • the feeding receiving unit 606 receives the feeding instruction information transmitted from the information processing device 10 or the like.
  • the aquatic animal detection system 301 is provided with the feeding device 600 connected to the network in this way, the feeding work can be automated or executed remotely. Further, the feeding device 600 feeds based on the feeding instruction information transmitted from the information processing device 10. Therefore, the information processing device 10 generates feeding instruction information based on the growth state of the aquatic animal determined through the detection operation in the cage P, and the feeding device 600 is made to execute the feeding operation based on the generated feeding instruction information. be able to. Therefore, in the cage P, it becomes possible to accurately feed while detecting the growing state of aquatic animals.
  • the information processing device 10 may determine the feeding amount according to the average fish body size in real time, and transmit the amount of food to be fed in real time as feeding instruction information. Further, it may be instructed to automatically stop feeding when the feeding amount reaches a predetermined threshold value.
  • sufficient food is given to small fish in the cage P based on the fish activity index and fish size that can be measured in real time. You may decide whether or not you have it and adjust the feeding time and amount.
  • the total amount of satiety feeding may be calculated by feeding the entire cage P until it becomes satiety by utilizing the measured fish body activity index (satiation index) and fish body size distribution.
  • the user may use the terminal device 60 to transmit a feeding instruction or the like to the information processing device 10, and the information processing device 10 may be able to transmit the feeding instruction information to the feeding device 600 accordingly. ..
  • the feeding instruction an identifier that identifies the feeding device 600 may be specified, or the cage identifier of the cage P may be specified.
  • the feeding instruction may be transmitted from the terminal device 60 to the feeding device 600 via the network.
  • the feeding device 600 may be configured to perform the feeding operation based on the received information.
  • the feeding operation by the feeding device 600 and the shooting by the camera 281 may be performed in conjunction with each other. It is difficult to adjust the shooting range by moving the camera 281 in the water, but it is detected per unit time by guiding the aquatic animals by feeding operation so that the aquatic animals that eat food are photographed by the camera 281. The possible number of individuals can be increased. In addition, more accurate detection can be performed by guiding the entire aquatic animal to fit in the image in relation to the photographing range of the camera 281.
  • the information processing device may calculate the time when it is recommended to perform the detection work next and notify the user. For example, when the growth state is close to the ready-to-ship state or the growth state is close to the abnormal value, the period until the next detection opportunity is relatively shortened, and the normal growth state can be shipped. If it is expected that it will take some time to reach the state, the period until the next detection opportunity may be relatively long.
  • the fish activity index (satiation index) may be obtained by quantifying the swimming activity rate of aquatic animals by image analysis or machine learning.
  • the information that identifies the relationship between the bait information (size, type) stored in advance and the fish body size is stored in advance in the storage unit of the information processing device, and the optimum bait for the fish body size measured in real time is determined. , The user may be notified. In this case, the information processing device may acquire information on the food currently being fed and notify the user when the optimum food and the registered food are different.
  • the processing unit of the information processing device has obtained the growth rate and growth rate of fish under similar conditions obtained from the same past cage, the current adjacent benchmark, or the benchmark of another producer.
  • Benchmarks mean and median
  • the processing unit may also recommend an appropriate feeding method to approach the benchmark.
  • the detection unit of the information processing device may detect an abnormal value based on the relationship of each parameter of the past biological information stored in the biological information storage unit. For example, it is possible to detect whether or not overfeeding or undergrowth has occurred by comparing the relationship between the past feeding amount and the change in the size of aquatic animals with the current information.
  • the information processing apparatus may accept the input of information performed by the worker who has confirmed the image taken by the camera, and may acquire information such as the fish body length based on the received information.
  • the information processing device transmits an image or an image analysis result to the terminal device operated by the worker, and then the information processing device receives the information transmitted from the terminal device operated by the worker. You just have to do it.
  • the result of detection by the detection unit may be transmitted to the worker as a provisional one, and the worker may confirm whether or not the transmitted information is appropriate. ..
  • biological information may be accumulated based on the detection result confirmed to be appropriate by the operator.
  • the worker identifies the area of the object contained in the image, annotates the attribute of the area (whether or not it is an aquatic organism, etc.), and measures based on the result. May be done. In this way, even when the work by the worker intervenes or the work by the worker and the processing performed by the information processing apparatus are performed in parallel, the detection work can be easily performed.
  • FIG. 23 is an overview view of the computer system 800 according to the above embodiment.
  • FIG. 24 is a block diagram of the computer system 800.
  • the computer system 800 includes a computer 801 including a CD-ROM drive, a keyboard 802, a mouse 803, and a monitor 804.
  • the computer 801 is connected to the MPU 8013, the bus 8014 connected to the CD-ROM drive 8012, the ROM 8015 for storing programs such as the bootup program, and the MPU 8013, and the application. It includes a RAM 8016 for temporarily storing program instructions and providing a temporary storage space, and a hard disk 8017 for storing application programs, system programs, and data.
  • the computer 801 may further include a network card that provides a connection to the LAN.
  • the program for causing the computer system 800 to execute the functions of the information processing apparatus and the like according to the above-described embodiment may be stored in the CD-ROM 8101, inserted into the CD-ROM drive 8012, and further transferred to the hard disk 8017.
  • the program may be transmitted to the computer 801 via a network (not shown) and stored on the hard disk 8017.
  • the program is loaded into RAM 8016 at run time.
  • the program may be loaded directly from the CD-ROM 8101 or the network.
  • the program does not necessarily have to include an operating system (OS) or a third-party program that causes the computer 801 to execute the functions of the information processing apparatus and the like according to the above-described embodiment.
  • the program need only include a portion of the instruction that calls the appropriate function (module) in a controlled manner to obtain the desired result. It is well known how the computer system 800 works, and detailed description thereof will be omitted.
  • processing performed by hardware for example, processing performed by a modem or interface card in the transmission step (only performed by hardware). Processing that is not done) is not included.
  • the number of computers that execute the above program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.
  • the two or more components existing in one device may be physically realized by one medium.
  • each process may be realized by centralized processing by a single device (system), or may be realized by distributed processing by a plurality of devices. (In this case, it is possible to grasp the entire system composed of a plurality of devices that perform distributed processing as one "device").
  • the transfer of information performed between the respective components depends on, for example, one of the components when the two components that transfer the information are physically different. It may be performed by outputting information and accepting information by the other component, or when the two components that pass the information are physically the same, one component. It may be performed by moving from the processing phase corresponding to the above to the processing phase corresponding to the other component.
  • information related to the processing executed by each component for example, information received, acquired, selected, generated, transmitted, or received by each component.
  • information such as threshold values, mathematical formulas, and addresses used by each component in processing may be temporarily or for a long time held in a recording medium (not shown) even if it is not specified in the above description.
  • each component or a storage unit may accumulate information on a recording medium (not shown).
  • each component or a reading unit may read the information from the recording medium (not shown).
  • the information used in each component or the like for example, the information such as the threshold value and the address used in the processing by each component and various setting values may be changed by the user, the above Although not specified in the description, the user may or may not be able to change the information as appropriate.
  • the change is realized by, for example, a reception unit (not shown) that receives a change instruction from the user and a change unit (not shown) that changes the information in response to the change instruction. You may.
  • the reception unit may accept the change instruction from, for example, an input device, information transmitted via a communication line, or information read from a predetermined recording medium. ..
  • the aquatic animal detection device has the effect of being able to easily perform work involving the detection of aquatic animals in water, and is useful as an aquatic animal detection device or the like.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Environmental Sciences (AREA)
  • Zoology (AREA)
  • Marine Sciences & Fisheries (AREA)
  • Animal Husbandry (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Farming Of Fish And Shellfish (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Catching Or Destruction (AREA)

Abstract

Avec les dispositifs de détection d'animaux aquatiques antérieurs, il n'était pas possible d'effectuer facilement des opérations accompagnant la détection d'un animal aquatique dans l'eau. L'invention concerne un dispositif de détection d'animal aquatique 10D qui comprend : une unité d'acquisition d'image 32 qui acquiert une image photographiée par une caméra 81 ; une unité de détection 33 qui détecte un animal aquatique représenté dans l'image ; une unité de détermination de notification 35 qui détermine si des conditions de notification ont été satisfaites concernant l'état de détection de l'animal aquatique par l'unité de détection 33 ; et une unité de génération de notification 36 qui génère des informations de notification lorsqu'il a été déterminé par l'unité de détermination de notification 35 que les conditions de notification ont été satisfaites, ce qui permet d'effectuer facilement des opérations accompagnant la détection d'un animal aquatique dans l'eau.
PCT/JP2019/033711 2019-08-28 2019-08-28 Dispositif de détection d'animal aquatique, dispositif de traitement d'informations, dispositif de terminal, système de détection d'animal aquatique, procédé de détection d'animal aquatique et programme de détection d'animal aquatique WO2021038753A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2020508060A JP6842100B1 (ja) 2019-08-28 2019-08-28 水棲動物検出装置、情報処理装置、端末装置、水棲動物検出システム、水棲動物検出方法、及び水棲動物検出プログラム
PCT/JP2019/033711 WO2021038753A1 (fr) 2019-08-28 2019-08-28 Dispositif de détection d'animal aquatique, dispositif de traitement d'informations, dispositif de terminal, système de détection d'animal aquatique, procédé de détection d'animal aquatique et programme de détection d'animal aquatique
JP2021015663A JP2021164444A (ja) 2019-08-28 2021-02-03 水棲動物検出装置、情報処理装置、端末装置、水棲動物検出システム、水棲動物検出方法、及び水棲動物検出プログラム

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/033711 WO2021038753A1 (fr) 2019-08-28 2019-08-28 Dispositif de détection d'animal aquatique, dispositif de traitement d'informations, dispositif de terminal, système de détection d'animal aquatique, procédé de détection d'animal aquatique et programme de détection d'animal aquatique

Publications (1)

Publication Number Publication Date
WO2021038753A1 true WO2021038753A1 (fr) 2021-03-04

Family

ID=74684379

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/033711 WO2021038753A1 (fr) 2019-08-28 2019-08-28 Dispositif de détection d'animal aquatique, dispositif de traitement d'informations, dispositif de terminal, système de détection d'animal aquatique, procédé de détection d'animal aquatique et programme de détection d'animal aquatique

Country Status (2)

Country Link
JP (2) JP6842100B1 (fr)
WO (1) WO2021038753A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022190375A1 (fr) * 2021-03-12 2022-09-15 ソフトバンク株式会社 Programme de traitement d'informations, procédé de traitement d'informations et dispositif de traitement d'informations
WO2022255152A1 (fr) * 2021-06-03 2022-12-08 ソニーグループ株式会社 Dispositif de mesure, procédé de mesure et programme
WO2023170771A1 (fr) * 2022-03-08 2023-09-14 ウミトロン株式会社 Dispositif de gestion, procédé d'alimentation et programme

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117178161A (zh) * 2021-03-31 2023-12-05 古野电气株式会社 计算机程序、模型生成方法、推断方法以及推断装置
KR102409745B1 (ko) * 2021-07-15 2022-06-15 유병자 양식 어류의 사료계수 자동측정장치
KR102537966B1 (ko) * 2022-06-14 2023-05-31 (주)오투컴퍼니 Ai를 이용한 유휴양식장에서의 물고기 양식 및 판매를 위한 통합 관리 시스템 및 방법

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09262040A (ja) * 1996-03-27 1997-10-07 Hitachi Ltd 水棲生物用自動給餌装置及び方法
JP2000131023A (ja) * 1998-10-29 2000-05-12 Keisuke Ueno 魚槽内の活魚計測装置
WO2009008733A1 (fr) * 2007-07-09 2009-01-15 Feed Control Norway As Moyens et procédé de détermination du poids moyen et d'alimentation en fonction de l'appétit
JP2009104406A (ja) * 2007-10-23 2009-05-14 Yanmar Co Ltd 防除請負管理システム
JP2016165238A (ja) * 2015-03-09 2016-09-15 Necソリューションイノベータ株式会社 同一魚判定装置、魚計数装置、魚計数用携帯端末、同一魚判定方法、魚計数方法、魚数予測装置、魚数予測方法、同一魚判定システム、魚計数システムおよび魚数予測システム
JP2016202094A (ja) * 2015-04-23 2016-12-08 有限会社Ykテクノリサーチ 甲殻類ソフトシェルの自動化量産装置
WO2017204660A1 (fr) * 2016-05-24 2017-11-30 Itecsolutions Systems & Services As Agencement et procédé de mesure de la masse biologique de poissons, et utilisation de cet agencement
JP2018046752A (ja) * 2016-09-20 2018-03-29 マイコム株式会社 野菜自動収穫装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010152685A (ja) * 2008-12-25 2010-07-08 Brother Ind Ltd 位置検出方法及び装置
JP2017181766A (ja) * 2016-03-30 2017-10-05 Kddi株式会社 水中監視装置、水上通信端末、及び水中監視システム
WO2018198236A1 (fr) * 2017-04-26 2018-11-01 三菱電機株式会社 Système, programme et procédé de culture

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09262040A (ja) * 1996-03-27 1997-10-07 Hitachi Ltd 水棲生物用自動給餌装置及び方法
JP2000131023A (ja) * 1998-10-29 2000-05-12 Keisuke Ueno 魚槽内の活魚計測装置
WO2009008733A1 (fr) * 2007-07-09 2009-01-15 Feed Control Norway As Moyens et procédé de détermination du poids moyen et d'alimentation en fonction de l'appétit
JP2009104406A (ja) * 2007-10-23 2009-05-14 Yanmar Co Ltd 防除請負管理システム
JP2016165238A (ja) * 2015-03-09 2016-09-15 Necソリューションイノベータ株式会社 同一魚判定装置、魚計数装置、魚計数用携帯端末、同一魚判定方法、魚計数方法、魚数予測装置、魚数予測方法、同一魚判定システム、魚計数システムおよび魚数予測システム
JP2016202094A (ja) * 2015-04-23 2016-12-08 有限会社Ykテクノリサーチ 甲殻類ソフトシェルの自動化量産装置
WO2017204660A1 (fr) * 2016-05-24 2017-11-30 Itecsolutions Systems & Services As Agencement et procédé de mesure de la masse biologique de poissons, et utilisation de cet agencement
JP2018046752A (ja) * 2016-09-20 2018-03-29 マイコム株式会社 野菜自動収穫装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022190375A1 (fr) * 2021-03-12 2022-09-15 ソフトバンク株式会社 Programme de traitement d'informations, procédé de traitement d'informations et dispositif de traitement d'informations
WO2022255152A1 (fr) * 2021-06-03 2022-12-08 ソニーグループ株式会社 Dispositif de mesure, procédé de mesure et programme
WO2023170771A1 (fr) * 2022-03-08 2023-09-14 ウミトロン株式会社 Dispositif de gestion, procédé d'alimentation et programme

Also Published As

Publication number Publication date
JPWO2021038753A1 (ja) 2021-09-13
JP6842100B1 (ja) 2021-03-17
JP2021164444A (ja) 2021-10-14

Similar Documents

Publication Publication Date Title
JP6842100B1 (ja) 水棲動物検出装置、情報処理装置、端末装置、水棲動物検出システム、水棲動物検出方法、及び水棲動物検出プログラム
JP6695585B1 (ja) 水棲動物養殖支援システム、昇降装置、給餌装置、水棲動物の養殖方法、及び水棲動物養殖支援プログラム
CN109717120B (zh) 一种基于物联网的鱼类养殖监测投料系统及方法
JP6628379B2 (ja) 自動給餌支援装置、自動給餌支援方法、およびプログラム
JP2019170349A (ja) 水生生物生産管理システム
KR101598898B1 (ko) 음향 및 영상분석을 통한 넙치 질병 예방 시스템
KR101357890B1 (ko) 원격어항관리시스템
KR101814288B1 (ko) 3차원 분석을 이용한 양식장 사료 급이 시스템 및 그 방법
CN114424206A (zh) 在饲养场到达和风险评估中使用射频识别标签的uhf带询问的牲畜和饲养场数据采集和处理
US20230284600A1 (en) Smart aquaculture grow out system
US7317968B2 (en) Method and system for managing and operating a plurality of farm houses
JP2020078278A (ja) 養殖魚の自動給餌方法並びに自動給餌システム
KR101877271B1 (ko) 로드셀 기반의 가축 중량 측정 시스템 및 이를 이용한 가축의 표준중량 추정방법
US20050229864A1 (en) Method for monitoring and controlling in real-time the non-consumed food in fish farms
WO2020124232A1 (fr) Systèmes et procédés de prédiction de la croissance d'une population d'organismes
WO2021019457A2 (fr) Estimation de poids de poulets à l'aide d'une vision artificielle 3d et d'une intelligence artificielle
Karningsih et al. Automated fish feeding system for an offshore aquaculture unit
KR20160141247A (ko) 넙치 습성을 이용한 음향분석 먹이활성도 분석 시스템
WO2022123732A1 (fr) Dispositif de traitement, dispositif de collecte d'informations, procédé de traitement d'informations, et programme
CN109845654A (zh) 喂养系统及喂食方法
Cason et al. A multivariate assessment of factors influencing survival of Red Drum in earthen outdoor rearing ponds
TWI840653B (zh) 智慧型水產養殖養成系統
CN103719001B (zh) 一种科学养鱼设备
WO2023226563A1 (fr) Procédé et système d'identification de croissance animale
CN110414642A (zh) 一种基于二维码的农产品生产信息追溯系统及二维码生成方法

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2020508060

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19943425

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19943425

Country of ref document: EP

Kind code of ref document: A1