JPWO2018061928A1 - INFORMATION PROCESSING APPARATUS, COUNTING SYSTEM, COUNTING METHOD, AND COMPUTER PROGRAM - Google Patents

Abstract

In order to provide a technique capable of increasing the accuracy of object counting when measuring the number of objects using images captured by the imaging device, the information processing device 1 includes a detection unit 2, a counting unit 3, Is provided. The detection unit 2 detects a characteristic part having a predetermined feature in the measurement target object from a captured image in which the measurement target object is captured. The counting unit 3 measures the number of feature parts detected by the detection unit 2 in the captured image as the number of objects to be measured.

Description

  The present invention relates to a technique for measuring the number of objects using an imaging device.

  In order to improve fish farming techniques, it is practiced to monitor the growth of fish in culture. Patent Document 1 discloses a technique related to fish observation. According to the technique in this patent document 1, based on the photographed image of the dorsal side (or ventral side) of the fish photographed from the upper side (or bottom side) of the water tank and the lateral side, the photographed image of the front of the head side The shape and size of the head, torso, tail fin etc. are estimated for each part. The estimation of the shape and size of each part of the fish is performed using a plurality of template images given to each part. That is, the size of each part of the fish, etc. is checked based on known information such as the size of the part of the fish in the template image that matches the photographed image with the photographed image of each part. Is estimated.

  Patent Document 2 discloses a technique of capturing an underwater fish with a moving image camera and a still image camera, and detecting a fish shadow based on the captured moving image and the still image. In addition, Patent Document 2 shows a configuration in which the number of appearances appearing in a captured moving image is counted for each fish type such that the number of appearances is one for one locus of fish shadow obtained from the moving image. It is done.

Japanese Patent Application Publication No. 2003-250382 JP, 2013-201714, A

  Patent Document 2 shows a configuration for counting trajectories of fish shadows. In this configuration, for example, in the moving image, the locus of the fish shadow is temporarily interrupted due to the fish becoming a shadow of another fish, and if it appears again, the locus of another fish shadow despite the same fish Therefore, the number of appearances is two. That is, the number of fish shadows counted by the configuration shown in Patent Document 2 is its locus, which may differ from the number of fish, and in the configuration of Patent Document 2, improvement of the counting accuracy of the number of fish is difficult .

  The present invention has been devised to solve the above problems. That is, the main object of the present invention is to provide a technique capable of enhancing the accuracy of counting of objects when measuring the number of objects using a photographed image by a photographing device.

In order to achieve the above object, the information processing apparatus of the present invention is
A detection unit for detecting a characteristic site having a predetermined feature in the object to be measured from a photographed image in which the object to be measured is photographed;
And a counting unit configured to measure the number of the detected characteristic portions in the captured image as the number of objects to be measured.

The counting system of the present invention is
A photographing device for photographing a photographing space in which an object to be measured exists;
An information processing apparatus configured to measure the number of objects to be measured in the imaging space based on an image captured by the imaging apparatus;
The information processing apparatus is
A detection unit that detects a characteristic site having a predetermined feature in the object to be measured from a photographed image in which the object to be measured is photographed;
And a counting unit configured to measure the number of the detected characteristic portions in the captured image as the number of objects to be measured.

The counting method of the present invention is
Detecting a characteristic portion having a predetermined feature in the object to be measured from a photographed image in which the object to be measured is photographed;
The number of detected characteristic parts in the photographed image is measured as the number of objects to be measured.

The program storage medium of the present invention is
A process of detecting a characteristic portion having a predetermined feature in the object to be measured from a photographed image in which the object to be measured is photographed;
A computer program that causes a computer to execute a process of measuring the number of detected characteristic portions in the captured image as the number of objects to be measured is stored.

  The above main object of the present invention is also achieved by the counting method of the present invention corresponding to the information processing apparatus of the present invention. The above main object of the present invention is also achieved by the information processing apparatus of the present invention, a computer program corresponding to the counting method of the present invention, and a program storage medium storing the same.

  According to the present invention, when measuring the number of objects using a photographed image by the photographing device, it is possible to improve the accuracy of counting of the objects.

It is a block diagram simplifying and showing composition of an information processor of a 1st embodiment concerning the present invention. It is a block diagram simplifying and showing composition of a counting system provided with an information processor of a 1st embodiment. It is a block diagram which simplifies and represents the structure of the counting system of 2nd Embodiment which concerns on this invention. It is a figure explaining the arrangement | positioning form of the camera which is an imaging device in 2nd Embodiment. It is a figure explaining an example in the state where the camera in a 2nd embodiment was put into production. It is a figure showing an example of the photography range of the camera in a 2nd embodiment. It is a figure showing an example of the photography picture by the camera in a 2nd embodiment. It is a figure showing an example of reference data which a detection part in a 2nd embodiment uses by detection processing. It is a figure showing an example of the reference data which a detection part in a 2nd embodiment uses by detection processing following Drawing 8A. It is a figure explaining the detection process of the detection part in 2nd Embodiment. It is a flowchart showing the operation example which concerns on the count of the control apparatus in 2nd Embodiment. It is a figure explaining the arrangement | positioning form of the camera in 3rd Embodiment which concerns on this invention. It is a figure showing an example of the photography range of the camera in a 3rd embodiment. It is a figure showing an example of reference data which a detection part in a 3rd embodiment uses by detection processing. 14 is a diagram illustrating an example of reference data used by the detection unit in the third embodiment in detection processing, following FIG. It is a figure showing an example of another reference data. It is a figure showing an example of another reference data following FIG. It is a figure explaining the arrangement | positioning form of the camera in 4th Embodiment concerning this invention. It is a figure showing an example of the photography range of the camera in a 4th embodiment. It is a figure explaining the functional composition of the control device in a 4th embodiment. It is a figure showing other embodiment of the arrangement | positioning form of a camera. It is a figure showing an example of the imaging | photography range of the camera arrange | positioned like FIG. FIG. 10 is a diagram illustrating still another embodiment of the arrangement of the camera. FIG. 24 is a view for explaining an example of a state in which a camera disposed as shown in FIG. 23 is produced. It is a figure showing an example of the imaging | photography range of the camera arrange | positioned like FIG. It is a figure showing the further another example of reference data. FIG. 26 is a diagram illustrating still another example of reference data.

  Hereinafter, an embodiment according to the present invention will be described with reference to the drawings.

First Embodiment
FIG. 1 is a block diagram schematically showing the configuration of the information processing apparatus according to the first embodiment of the present invention. The information processing apparatus 1 according to the first embodiment, as shown in FIG. The photographing device 6 is disposed in a state of photographing a photographing space in which an object to be measured exists.

  The information processing apparatus 1 includes a detection unit 2 and a counting unit 3 as functional units. The detection unit 2 has a function of detecting a characteristic site having a predetermined feature in the object to be measured from a photographed image in which the object to be measured is photographed. The counting unit 3 has a function of measuring the number of characteristic portions detected by the detection unit 2 in the photographed image as the number of objects to be measured.

  The information processing apparatus 1 according to the first embodiment detects a characteristic part of an object to be measured in a captured image and measures the number of the detected characteristic parts as the number of objects to be measured. The accuracy of counting objects can be increased.

Second Embodiment
The second embodiment according to the present invention will be described below.

  FIG. 3 is a block diagram showing a simplified configuration of a counting system according to a second embodiment of the present invention. The counting system 10 in the second embodiment is a system for measuring the number of fish in a ginger which is an object to be measured. The counting system 10 includes a camera 11 which is a photographing device and an information processing device 12.

  The camera 11 has a waterproof function, and as shown in FIG. 5, the camera 11 is disposed in the ginger 25 in which the fish 26 are cultured. In the second embodiment, the camera 11 is disposed at a position near the bottom of the water. The position of the camera 11 in a cross section parallel to the water surface of the raw fish 25 is approximately at the center. The orientation of the lens of the camera 11 disposed at such a position is directed to the water surface (upward). Also, the camera 11 has a shooting range (field of view) as shown in FIG. That is, the imaging | photography range of the camera 11 is a range which can also image | photograph the side of the production | generation 25 in consideration of the magnitude | size of the production | generation 25. FIG.

  Although the method in particular of arrange | positioning the camera 11 in water is not limited, the example is described next. That is, each of the cameras 11 is supported and fixed on the metal plate 20 as a supporting member as shown in FIG. 4 so that the direction of the lens is upward (the direction facing the upper side of the substrate surface of the metal plate 20). Be done. The metal plate 20 on which the camera 11 is supported and fixed is connected to the buoy 22 which is a floating body by a plurality of (four) ropes 21 which are wire members. Further, the opposite end side of the buoy 22 in each rope 21 is connected to the weight 23.

  When the arrangement structure of the camera 11 having such a configuration is introduced into the water (raw water 25), the buoy 22 floats to the water surface, and the weight 23 sinks to the water bottom side, whereby the metal plate 20 is a rope 21 is suspended in water. Further, the weight 23 prevents the arrangement position of the metal plate 20 (in other words, the camera 11) from being largely changed. As described above, the method of arranging the camera 11 in water by the metal plate 20, the rope 21, the buoy 22, and the weight 23 has a simple structure and is easy to be compact and lightweight. From this, it becomes easy to move the camera 11 to another ginger 25.

  The camera 11 thus disposed in the water shoots the fish 26 in the ginger 25 from the ventral side. For example, the fish 26 in the image captured by the camera 11 is an image as shown in the image view of FIG. 7.

  Although the camera 11 is a photographing device having a function of photographing a moving image, a photographing device that intermittently photographs, for example, a still image at each setting time interval without adopting a moving image photographing function is adopted as the camera 11 You may Further, the calibration of the camera 11 is performed by an appropriate calibration method in consideration of the environment of the ginger 25, the type of fish to be measured, and the like. Here, the description of the calibration method is omitted.

  Further, as a method of starting photographing by the camera 11 and a method of stopping photographing, an appropriate method in which the performance of the camera 11, the environment of the production 25 and the like are considered is adopted. For example, a fish observer manually starts shooting before the camera 11 enters the ginger 25 and stops shooting manually after the camera 11 is withdrawn from the ginger 25. Further, when the camera 11 has a wireless communication or wired communication function, the camera 11 is connected with an operation device capable of transmitting information for controlling the start and the stop of the shooting. Then, the photographing start and the photographing stop of the camera 11 in the water may be controlled by the operation of the operation device by the observer.

  The captured image captured by the camera 11 as described above may be captured by the information processing apparatus 12 by wired communication or wireless communication, or may be stored in the portable storage medium and then stored in the portable storage medium to process the information processing apparatus from the portable storage medium It may be incorporated into T.12.

  The information processing apparatus 12 generally includes a control device 13 and a storage device 14 as shown in FIG. 3. The information processing apparatus 12 is connected to an input device (for example, a keyboard or a mouse) 16 for inputting information to the information processing apparatus 12 by an operation of an observer (measurer), for example, and a display device 17 for displaying information. There is. Furthermore, the information processing device 12 may be connected to an external storage device 15 separate from the information processing device 12.

  The storage device 14 has a function of storing various data and a computer program (hereinafter also referred to as a program), and is realized by a storage medium such as a hard disk device or a semiconductor memory, for example. The storage device 14 included in the information processing device 12 is not limited to one, and multiple types of storage devices may be included in the information processing device 12. In this case, a plurality of storage devices are collectively referred to. It is referred to as a storage device 14. The storage device 15 also has a function of storing various data and computer programs as the storage device 14 and is realized by a storage medium such as a hard disk device or a semiconductor memory, for example. When the information processing device 12 is connected to the storage device 15, appropriate information is stored in the storage device 15. Further, in this case, the information processing apparatus 12 appropriately executes the process of writing and reading information in the storage device 15, but in the following description, the description of the storage device 15 is omitted.

  In the second embodiment, the storage device 14 stores an image captured by the camera 11 in a state of being associated with information relating to the imaging condition such as information representing the captured camera and information of imaging time.

  The control device 13 is configured of, for example, a CPU (Central Processing Unit). The control device 13 can have the following functions, for example, by the CPU executing a computer program stored in the storage device 14. That is, the control device 13 includes a detection unit 30, a counting unit 31, and a display control unit 32 as functional units.

  The display control unit 32 has a function of controlling the display operation of the display device 17. For example, when the display control unit 32 receives a request to reproduce a photographed image of the camera 11 from the input device 16, the display control unit 32 reads the photographed image of the camera 11 according to the request from the storage device 14 and displays the photographed image. Display on

  For example, when detecting that a request to measure the number of fish has been input by the operation of the input device 16 by the observer during reproduction of a captured image of the camera 11, the detection unit 30 executes the following processing. Is equipped. That is, the detection unit 30 has a function of detecting, in a captured image by the camera 11, a characteristic portion having a predetermined feature of a fish which is an object to be measured. In the second embodiment, the head of the fish is set as the feature portion. There are various methods for detecting the head of a fish which is a characteristic part from the photographed image of the camera 11, and here, an appropriate method in consideration of the processing capability of the information processing apparatus 12 is adopted. There are the following methods to mention.

  For example, with respect to the head of the type of fish to be measured, a plurality of reference data (reference part images) different in the direction of the fish and the distance from the camera 11 as shown in FIGS. It is done. The reference data in FIGS. 8 and 9 is an image of a fish's head viewed from the ventral side of the fish. As these reference data, an image of an area in which a characteristic region of the head is photographed is extracted as teacher data (teacher image) from a large number of photographed images in which fish of the type to be measured are photographed. Created by machine learning.

  The detection unit 30 detects the characteristic portion in the captured image as follows, using the reference data of the characteristic portion (fish's head) read out from the storage device 14 as follows. For example, the detection unit 30 moves the survey image range having a predetermined shape and size from the upper left end of the captured image 46 as shown in FIG. 10 toward the upper right end at each setting interval. The image of the portion where the survey image range is located is compared with the reference data. Then, the detection unit 30 determines the degree of matching (similarity) between the image within the survey image range and the reference data, for example, by a method used in the template matching method. When the matching degree is equal to or higher than a threshold (for example, 90%), the detecting unit 30 detects that the image represents a feature portion.

  When the detection unit 30 moves the survey image range to the upper right end, while the survey image range is moved to the right from the position lower than the upper left end in the captured image 46 by the setting interval, the matching degree for each setting interval as described above Let's judge.

  The detection unit 30 determines the degree of matching between the reference data and the image within the survey image range while scanning (scanning) the survey image range in the captured image in this manner, the object to be measured in the image captured by the camera 11 Detect the feature (head) of (fish). In the example of FIG. 10, the feature portion detected in the captured image 46 is represented by a frame 48. For example, the display control unit 32 displays the detection result by the detection unit 30 on the display device 17.

  The counting unit 31 has a function of measuring the number of characteristic portions detected by the detection unit 30 in the image captured by the camera 11 as the number of objects (fish) to be measured. Further, the counting unit 31 has a function of storing the information of the number of objects to be measured thus counted in the storage device 14 in a state in which the information of the measured image (for example, identification information of the photographed image) is associated. ing.

  The counting unit 31 may have a function of correcting the count value after counting the number of feature parts. For example, it is assumed that there is a fish that can not be counted by the counting unit 31 due to a cause such as being hidden in another fish shadow and therefore not appearing in the photographed image. The relationship between the number of uncounted fish and the number of fish counted by the counting unit 31 is obtained, for example, by observation or simulation, and the relationship data is stored in the storage device 14 as correction data. After counting the number of characteristic portions, the counting unit 31 may correct the count value using the correction data, and calculate the value after correction as the number of objects to be measured.

  The counting system 10 of the second embodiment is configured as described above. Next, an example of the counting process of the information processing apparatus 12 in the second embodiment will be described based on the flowchart of FIG.

  For example, when the detection unit 30 of the information processing device 12 detects that the request for counting the object to be measured has been input by the operation of the input device 16 by the observer (step S101), the captured image of the camera 11 is stored. Acquired from the device 14. Then, the detection unit 30 detects a characteristic site of the object to be measured using the reference data stored in the storage device 14 in the acquired image captured by the camera 11 (step S102). After that, the counting unit 31 measures the number of characteristic portions in the captured image detected by the detecting unit 30 (step S103). Then, the counting unit 31 causes the display control unit 32 to display the number of measured objects on the display device 17, for example. The information processing apparatus 12 can measure and output the number of objects to be measured from the captured image by such processing.

  In the counting system 10 according to the second embodiment, the detection unit 30 and the counting unit 31 of the information processing apparatus 12 detect the characteristic regions of the object to be measured in the photographed image, and the number of characteristic regions is the number of objects to be measured It has a function to measure. Thus, the information processing apparatus 12 can increase the accuracy of counting of objects with a simple configuration.

Third Embodiment
The third embodiment according to the present invention will be described below. In the description of the third embodiment, the same components as the components of the counting system in the second embodiment are designated by the same reference numerals, and the redundant description of the common components is omitted.

  The counting system 10 according to the third embodiment is different from the second embodiment in the arrangement of the camera 11 which is a photographing device, and other than that, the configuration is substantially the same as the counting system 10 according to the second embodiment.

  That is, FIG. 12 is a perspective view schematically showing the arrangement of the camera 11 in the third embodiment. That is, the camera 11 is fixed to the metal plate 20 in the horizontal direction such that the direction of the lens is parallel to the substrate surface of the metal plate 20 as the support member. In other words, the camera 11 is disposed so as to be sideways parallel to the water surface in a state of being introduced into the water (raw water 25). Further, the depth position (height position) of the camera 11 in water is a position that is an intermediate portion between the water bottom and the water surface. Furthermore, the camera 11 is arranged at the periphery of the ginger 25. FIG. 13 is a diagram showing the relationship between the shooting range of the camera 11 and the ginger 25 when the ginger 25 is viewed from the upper side.

  The camera 11 will be arrange | positioned as mentioned above, and will image | photograph the fish in the ginger 25 from the side. Therefore, reference data used by the detection unit 30 in the information processing apparatus 12 in the detection process is a sample image of a fish's head viewed from the side as shown in FIGS. 14 and 15.

  Also in the counting system 10 of the third embodiment, as in the second embodiment, the characteristic part of the object to be measured is detected from the photographed image, and the number of the characteristic parts is calculated as the number of objects to be measured. The same effect as that of the second embodiment can be obtained.

  In the third embodiment, the head of a fish is mentioned as an example as the characteristic portion of the object to be measured. Alternatively, for example, the feature part of the object to be measured may be a fish tail. In this case, reference data used by the detection unit 30 in the detection process is, for example, a sample image of a fish's tail viewed from the side as shown in FIGS. 16 and 17.

Fourth Embodiment
The fourth embodiment according to the present invention will be described below. In the description of the fourth embodiment, the same components as those in the counting system in the second and third embodiments are designated by the same reference numerals, and the redundant description of the common components is omitted.

  The counting system 10 in the fourth embodiment differs from the second and third embodiments in the arrangement form of the camera which is a photographing device, and is substantially the same as the counting system 10 in the second or third embodiment except the above. It has the following configuration.

  That is, FIG. 18 is a view schematically showing an arrangement of cameras in the fourth embodiment. The counting system 10 according to the fourth embodiment includes cameras 11 and 40 which are a plurality of (two in the example of FIG. 18) imaging devices. The cameras 11 and 40 are disposed at intervals in the depth direction (height direction) in a state where the cameras 26 are inserted into the raw fish 25 in which the fish 26 are cultured. In the fourth embodiment, with regard to the position in the depth direction of the cameras 11 and 40, the camera 11 is disposed at a position near the bottom of the water, and the camera 40 is disposed substantially in the middle between the bottom and the water surface. . Further, the positions of the cameras 11 and 40 in a cross section parallel to the water surface of the raw fish 25 are approximately at the center. The orientations of the lenses of the cameras 11 and 40 disposed at such positions are directed (facing upward) to the water surface. Further, in consideration of the size of the ginger 25, the photographing range (field of view) of the cameras 11 and 40 is a range in which the side of the ginger 25 can also be photographed. As in the second embodiment, the captured images of the cameras 11 and 40 disposed in this manner capture the fish 26 in the ginger 25 from the ventral side.

  A method similar to the method described in the second embodiment can be adopted as a method of arranging the cameras 11 and 40 in water. That is, the cameras 11 and 40 are disposed in the water in an arrangement form using the metal plate 20, the rope 21, the buoy 22, and the weight 23. In addition, the method of arrange | positioning the cameras 11 and 40 in water is not limited to the method of utilizing the rope 21, For example, it may be the method of replacing with the rope 21 and using a rod-shaped member.

  In the fourth embodiment, a plurality of cameras 11 and 40 are provided, whereby an image captured by each of the cameras 11 and 40 can be obtained. As a result, the detection unit 30 and the counting unit 31 in the information processing apparatus 12 execute processing for each of the plurality of captured images obtained. Then, the counting unit 31 sums the number of objects measured from the images captured by the cameras 11 and 40, and calculates the total value as the number of objects to be measured.

  Note that the information processing apparatus 12 uses a captured image of the camera 11 and a captured image of the camera 40 captured at the same time. In order to make it easy to obtain an image taken by the camera 11 and an image taken by the camera 40 at the same time in consideration of this, it is also possible to use the camera 11, 40 as a mark serving as a mark used for time alignment (synchronization) during shooting. It is preferable to shoot commonly. For example, light that is emitted for a short time by automatic control or manually by the observer may be used as a mark used for synchronization, and the cameras 11 and 40 may capture the light. Alternatively, the camera 11 or 40 may capture a sound as a mark used for synchronization together with the image. Alternatively, the clocks of the cameras 11 and 40 may be synchronized, and the cameras 11 and 40 may associate time information of the clock with the photographed image. As described above, by including or associating information used for synchronization with the captured images of the cameras 11 and 40, it becomes easy to synchronize the captured images of the cameras 11 and 40.

  By the way, in the fourth embodiment, the cameras 11 and 40 are arranged at intervals in the depth direction, and the orientations of the lenses are the same (upward). Therefore, the imaging range of the camera 11 has an area that overlaps with the imaging range of the camera 40, such as the hatched area W in FIG. Therefore, the number of objects to be measured (fish) counted by the counting unit 31 from the photographed image by the camera 11 includes the number of objects (fish) to be measured by the counting unit 31 in the photographed image by the camera 40 It is assumed that In consideration of this, in the fourth embodiment, a function of correcting the number of objects to be measured counted by the counting unit 31 is provided. That is, as shown in FIG. 20, the control device 13 includes a correction unit 34 in addition to the configuration of the second and third embodiments. In FIG. 20, in the control device 13, the detection unit 30 and the display control unit 32 are omitted.

  The correction unit 34 is counted by the counting unit 31 based on the number of objects to be measured that are assumed to be counted by the counting unit 31 in an overlapping imaging range region in the cameras 11 and 40. It has a function to correct the number of objects to be measured.

  For example, the ratio of the number of objects to be measured which is considered to be counted by the counting unit 31 in the photographed image by the camera 40 out of the number of measurement objects counted by the counting unit 31 from the photographed image by the camera 11 is The observer or the like determines in advance whether the The data of the determined ratio is stored in the storage device 14 as a thinning rate (for example, 0.5 (50%)). In addition, various methods can be considered as a method of obtaining the thinning rate. For example, the observer determines the thinning rate based on the experience of the observer based on experiments. Alternatively, the thinning rate may be calculated based on a sample image (for example, a moving image of the movement of a fish) obtained by machine learning using, as teacher data, images captured by the cameras 11 and 40 captured in advance. Alternatively, the thinning rate may be calculated according to the imaging environment. As described above, there are various methods for obtaining the thinning rate, and the thinning rate is obtained by an appropriate method.

  The correction unit 34 calculates the correction number by multiplying the number of objects to be measured counted by the counting unit 31 in the image captured by the camera 11 by the thinning rate stored in the storage device 14. Then, the correction unit 34 corrects the number of objects to be measured counted by the counting unit 31 by subtracting the calculated correction number from the number counted as the number of objects to be measured by the counting unit 31. The correction unit 34 has a function of storing in the storage device 14 the information of the number of objects to be measured after the correction thus corrected. The correction unit 34 further has a function of causing the display control unit 32 to display the number of objects to be measured after correction on the display device 17.

  In the counting system 10 of the fourth embodiment, a plurality of cameras 11 and 40 are disposed in the depth direction. For this reason, the following effects can be obtained. For example, it is assumed that there is an object that is unclear in an image captured by the camera 11 because it is far from the camera 11. In this case, since the object is photographed by the camera 40 at a position closer than the camera 11, in the photographed image by the camera 40, the image of the object can be clarified more than the photographed image by the camera 11. . Since the image of the object to be measured can be clarified as described above, the information processing apparatus 12 can increase the measurement accuracy of the object to be measured by the counting function using the captured image.

  Further, in the fourth embodiment, there is an object that is redundantly measured due to the use of the photographed images of the plurality of cameras 11 and 40, but the information processing apparatus 12 can use the correction unit 34 to It is possible to correct the number of such overlapping objects. For this reason, the information processing apparatus 12 can prevent the occurrence of a defect due to the use of photographed images of the plurality of cameras 11 and 40.

Fifth Embodiment
The fifth embodiment according to the present invention will be described below. In the description of the fifth embodiment, the same components as those constituting the counting system in the second to fourth embodiments are designated by the same reference numerals, and the redundant description of the common components is omitted.

  The counting system 10 according to the fifth embodiment is different from that according to the fourth embodiment in the arrangement of the camera which is the photographing device, and other than that, the configuration is substantially the same as that of the counting system 10 according to the fourth embodiment.

  That is, FIG. 21 is a perspective view schematically showing the arrangement of the camera 50 in the fifth embodiment. FIG. 22 is a model diagram showing the arrangement of the camera 50 as viewed from the upper side of FIG. In the fifth embodiment, the position at which the camera 50 is disposed in the water (raw water 25) is such that the depth position Dt near the water bottom, the position Db near the water surface, and the distance between the positions Db and Dt are approximately equal. And the positions Dm1 and Dm2. Also, four cameras 50 are provided at each depth position (height position) where the camera 50 is provided. The four cameras 50 at each depth position are disposed facing in four different directions along the water surface, as shown in FIG. The plurality of cameras 50 as shown in FIG. 21 are disposed at the central portion of the ginger 25 as in the fourth embodiment.

  In the information processing apparatus 12 according to the fifth embodiment, the detection unit 30 detects a characteristic portion (head) of an object (fish) to be measured in a captured image of each camera 50. In the fifth embodiment, since the camera 50 captures a fish, which is an object to be measured, from the side, reference data used by the detection unit 30 in the process of detecting a characteristic site is, for example, shown in FIGS. Sample image of the fish's head seen from the side as

  The counting unit 31 measures the number of characteristic portions detected in the captured image of each camera 50, adds up the number of measurements in each captured image, and calculates the total value as the number of objects to be measured. In the fifth embodiment, the overlapping imaging range in the cameras 50 adjacent in the horizontal direction is, for example, the area W in FIG. In addition, there is a shooting range area that overlaps also in the shooting range of the cameras 50 adjacent in the height direction. The correction unit 34 corrects the number of objects to be measured calculated by the counting unit 31 in consideration of the number of objects to be measured that are measured redundantly in such overlapping imaging range regions.

  The counting system 10 of the fifth embodiment can increase the counting accuracy of the object to be measured by further increasing the number of cameras 50 in comparison with the fourth embodiment.

<Other Embodiments>
The present invention is not limited to the first to fifth embodiments, and various embodiments can be adopted. For example, in the fourth and fifth embodiments, a plurality of cameras 50 are disposed at the center of the ginger 25. Alternatively, for example, as illustrated in FIG. 24, the plurality of cameras 50 may be disposed at the periphery (corner in the example of FIG. 24) of the ginger 25. In this case, for example, as shown in FIG. 23, one camera 50 is disposed at each different depth position. FIG. 25 is a model view of the relationship between the camera 50 and the ginger 25 in FIG. 24 as viewed from the water surface side. As shown in FIG. 25, the orientation of the lens of the camera 50 at each depth position is the same in the horizontal direction toward the central portion of the ginger 25. In the case where the camera 50 is disposed at the periphery of the production line 25 as shown in FIGS. 24 and 25, a plurality of cameras 50 may be disposed at each depth position depending on the field of view of the camera 50. .

  As described above, when the camera 50 is disposed, the captured image of the camera 50 captures the fish 26 in the raw fish 25 from the side as in the fifth embodiment.

  In the fourth embodiment, the cameras 11 and 40 are disposed in two stages as shown in FIG. 18, and in the fifth embodiment, the cameras 50 are disposed in four stages as shown in FIG. It is set up. Instead of this, the number of stages in the case of arranging the cameras in a plurality of stages may be three or five or more depending on the intended depth range for counting the number of fish.

  Furthermore, in addition to the configurations of the second to fifth embodiments, image processing for reducing the turbidity of water in a captured image at an appropriate timing, such as before the detection unit 30 of the information processing apparatus 12 starts detection processing, Image processing may be performed to correct distortion of the fish due to water fluctuation. Further, image processing may be performed to correct a photographed image in consideration of photographing conditions such as water depth and brightness of an object. As described above, when the information processing apparatus 12 performs image processing (image correction) on the captured image in consideration of the imaging environment, it is possible to further improve the counting accuracy of the object to be measured. In addition, the information processing apparatus 12 can obtain an effect that the number of reference data can be reduced by using the photographed image thus subjected to the image correction.

  Furthermore, in the second and third embodiments, the detection unit 30 in the information processing apparatus 12 detects the fish's head as the characteristic portion of the object to be measured. Instead of this, for example, the detection unit 30 may detect the side part of the fish. In this case, reference data used by the detection unit 30 in the detection process is, for example, a sample image of the side portion of the fish as shown in FIGS. 26 and 27.

  Furthermore, the reference data represented by FIGS. 14 to 17 used by the detection unit 30 is an example, and the reference data used by the detection unit 30 may include more reference data. For example, as reference data for the head or tail of a fish, data such as closeout data in FIG. 27 (that is, image data in which a part of the detected portion is out of the imaging range) includes data other than the detection target. It may be Also, data representing a fish's tail bend in consideration of the fish's bend as shown in FIG. 27 may be included as reference data.

  Furthermore, in the second to fifth embodiments, a fish is described as an example of an object to be measured, but the counting system 10 having the configuration described in the second to fifth embodiments is another object. It is also applicable to the counting of

  The present invention has been described above by taking the above-described embodiment as an exemplary example. However, the present invention is not limited to the embodiments described above. That is, the present invention can apply various aspects that can be understood by those skilled in the art within the scope of the present invention.

  This application claims priority based on Japanese Patent Application No. 2016-194271 filed on Sep. 30, 2016, the entire disclosure of which is incorporated herein.

1, 12 information processing apparatus 2, 30 detection unit 3, 31 counting unit 5, 10 counting system 6 photographing apparatus 11, 40, 50 camera

Claims (9)

Detection means for detecting a characteristic site having a predetermined feature in the object to be measured from a photographed image in which the object to be measured is photographed;
An information processing apparatus, comprising: counting means for measuring the number of detected characteristic portions in the photographed image as the number of objects to be measured. The apparatus further includes the counting unit further having a function of measuring, as the number of objects to be measured, a total value of the number of characteristic portions measured from a plurality of the photographed images in which a part of the imaging range overlaps each other.
The information processing apparatus according to claim 1, further comprising a correction unit configured to correct the number of objects to be measured counted from the plurality of photographed images based on the overlapping imaging range.   The information processing apparatus according to claim 1, wherein the detection unit detects the characteristic portion from the photographed image by using a plurality of images of the characteristic portion in which photographing conditions of the object to be measured are different. . A photographing device for photographing a photographing space in which an object to be measured exists;
An information processing apparatus configured to measure the number of objects to be measured in the imaging space based on an image captured by the imaging apparatus;
The information processing apparatus is
Detection means for detecting a characteristic site having a predetermined feature in the object to be measured from a photographed image in which the object to be measured is photographed;
A counting system comprising: counting means for measuring the number of the detected characteristic portions in the photographed image as the number of the objects to be measured.   5. The counting system according to claim 4, further comprising a plurality of imaging devices, wherein the imaging devices are spaced apart from each other in a height direction in a predetermined imaging space.   The counting system according to claim 5, wherein a plurality of the imaging devices are disposed at the same height position in the imaging space. Each of the plurality of photographing devices is disposed so that the photographing range overlaps the photographing range of another photographing device.
The information processing apparatus according to claim 6, further comprising: a correction unit configured to correct the number of objects to be measured counted from the photographed image of the photographing apparatus based on the overlapping photographing range area. Counting system. Detecting a characteristic portion having a predetermined feature in the object to be measured from a photographed image in which the object to be measured is photographed;
The counting method which measures the number of the detected said characteristic site | parts in the said picked-up image as the number of objects of the said measurement object. A process of detecting a characteristic portion having a predetermined feature in the object to be measured from a photographed image in which the object to be measured is photographed;
A program storage medium storing a computer program that causes a computer to execute a process of measuring the number of detected characteristic portions in the captured image as the number of objects to be measured.

Images