KR102586237B1 - Monotoring and environment controlling system for breeding silkworm - Google Patents

Abstract

The silkworm growth monitoring and environment control system according to an embodiment of the present invention includes a silkworm growth cage, an image acquisition device for acquiring image information by photographing the silkworm growth cage, an environmental information measurement device, an environmental control device, a central control device, and the above. It includes a growth management server that generates silkworm growth status information and silkworm growth environment information based on image information and environmental information received from the devices and provides them to a user terminal, and the silkworm growth status information is calculated by analyzing the image information. Information on the amount of remaining mulberry leaves is included.

Description

Silkworm growth monitoring and environmental control system {MONOTORING AND ENVIRONMENT CONTROLLING SYSTEM FOR BREEDING SILKWORM}

The present invention relates to a silkworm growth monitoring and environment control system, and more specifically, to a silkworm growth monitoring and environment control system that can monitor silkworm growth conditions and the silkworm growth environment in real time and control the silkworm growth environment.

Problems such as aging farmers, labor shortage in rural areas, and shortage of manpower due to rising labor costs are also appearing in sericulture farms.

Silkworm rearing requires intensive labor during the 5th instar stage (about 10 to 15 days), but it is difficult to secure short-term labor on an irregular basis due to problems such as aging farmers and a shortage of labor in rural areas.

To solve this problem, Korean Patent No. 10-0261043 states that when the time to supply mulberry leaves arrives, the silkworm dung and mulberry leaf residues remaining in the large silkworm breeding means are removed by the dung change plate and mulberry leaf residue removal means, respectively, and the large silkworms are The mulberry leaves are selected and supplied to the mulberry leaf silkworm supply means by the silkworm transport means, and at the same time, the mulberry leaves collected by the mulberry leaf collection means and stored in the mulberry leaf storage bin are supplied to the mulberry leaf silkworm supply means via the mulberry leaf dispersion means along with the aforementioned silkworms. An automatic large silkworm rearing device is being disclosed that is configured to supply mulberry leaves to the large silkworm rearing means.

Although the conventional automatic rearing device was equipped with a means for transporting silkworms and a means for collecting mulberry leaves and was partially automated, it had limitations in that it could not remotely monitor the rearing status and rearing environment of silkworms in real time and control the rearing environment.

In addition, the conventional automatic rearing device had limitations in that it could not accurately control the feeding amount and feeding interval by automatically determining the development status of the silkworms and the remaining amount of mulberry leaves.

Korean Patent No. 10-0261043 (April 15, 2000)

The present invention is intended to solve the above problems, and specifically, to provide a silkworm growth monitoring and environment control system that can monitor silkworm growth status information and silkworm growth environment information in real time and remotely control the silkworm growth environment. The purpose.

The problems of the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

The silkworm growth monitoring and environment control system according to an embodiment of the present invention to solve the above problems includes a silkworm growth cage capable of accommodating silkworms and mulberry leaves; An image acquisition device that acquires image information by photographing the growth environment of the silkworm growth cage; An environmental information measuring device that measures environmental information of the silkworm growth cage; An environmental control device that controls the environment of the silkworm growth cage; a central control device that controls operation of the image acquisition device, the environmental information measurement device, and the environmental control device; And a growth management server that receives information received from the image acquisition device, the environmental information measurement device, and the environmental control device from the central control device, generates silkworm growth status information and silkworm growth environment information and provides them to the user terminal. In addition, the silkworm growth status information may include the image information acquired from the image acquisition device and information on the amount of remaining mulberry leaves calculated by analyzing the image information.

The growth management server calculates the ExG index based on the RGB data of the image information, binarizes the image information into the mulberry leaf and other parts using a binarization algorithm based on the calculated ExG index, and divides the entire ROI area. The mulberry leaf distribution rate can be calculated by dividing the pixel value of the binarized mulberry leaf area by the number of pixels.

The binarization algorithm may be the Otsh Thresholding algorithm.

The growth management server may transmit alarm information notifying that it is feeding time to the user terminal when the mulberry leaf distribution rate is lower than a preset reference value.

The growth management server detects a silkworm object image from the image information using a deep learning-based object detection algorithm, binarizes the silkworm area and the background area through image segmentation for the detected silkworm object image, and binarizes the binarized right area. calculate the number of pixels, and input the calculated number of pixels into a regression equation between the length, width, and weight values of the pre-built actual silkworm object and the number of silkworm pixels to obtain the length, width, and weight values of the detected silkworm object. The silkworm growth status information including can be generated and provided to the user terminal.

The environmental information measuring device may include a temperature sensor, a humidity sensor, and a carbon dioxide sensor.

The environmental control device may include an air conditioner, a humidifier, a dehumidifier, and a blower.

In addition, the silkworm growth monitoring and environment control system according to an embodiment of the present invention further includes a sound acquisition device for acquiring sound information generated from the silkworm growth cage, and the central control device is configured to control the sound information received from the silkworm growth cage. Sound information is transmitted to the growth management server, and the growth management server can calculate the amount information of the mulberry leaves by further considering the decibel level of the sound information.

The growth management server causes the image acquisition device to acquire captured images of the growth environment at a preset cycle through the central control device, and monitors the silkworm growth by date and time of the silkworms including the captured images and the amount information of the mulberry leaves. State information and the silkworm growth environment information are provided to the user terminal, and control commands for the image acquisition device, the environmental information measurement device, and the environmental control device are sent to the central control device according to a control request received from the user terminal. Can be transmitted.

The growth management server builds big data on the silkworm growth status information by date and time, the silkworm growth environment information, and the amount information of the mulberry leaves, and sets a standard value for controlling silkworm growth environment information to increase the growth rate of silkworms. It can be built.

The silkworm growth monitoring and environment control system according to an embodiment of the present invention can monitor silkworm growth status information and silkworm growth environment information in real time and remotely control the silkworm growth environment.

In addition, the silkworm growth monitoring and environment control system according to an embodiment of the present invention analyzes video information captured in silkworm growth cages and automatically determines information on the amount of remaining mulberry leaves to accurately determine the amount and feeding interval of silkworms. You can control it.

In addition, the silkworm growth monitoring and environment control system according to an embodiment of the present invention analyzes video information captured in the silkworm growth cage and automatically calculates the length, width, and weight of the silkworm, automatically determines silkworm growth status information, and automatically calculates the length, width, and weight of the silkworm. By building big data, the optimal silkworm growth environment can be established.

The effects according to the present invention are not limited to the contents exemplified above, and further various effects are included in the present specification.

1 is a schematic diagram of a silkworm growth monitoring and environmental control system according to an embodiment of the present invention.
Figure 2 is a detailed configuration diagram of the growth management server of Figure 1.
Figure 3 is a schematic flowchart explaining the operation of an embodiment of the silkworm growth monitoring and environment control system according to an embodiment of the present invention.
Figure 4 is a diagram showing real-time captured images provided to a user terminal by the silkworm growth monitoring and environment control system according to an embodiment of the present invention.
Figure 5 is an example diagram of an image processing method of the mulberry leaf distribution rate calculation unit of Figure 2.
Figures 6 and 7 are exemplary diagrams of an image processing method of the silkworm growth state information calculation unit of Figure 2.
Figure 8 is a graph showing the daily silkworm feeding amount and silkworm length provided to the user terminal by the output unit of Figure 2.
Figure 9 is a graph showing the daily silkworm feeding amount and silkworm width provided to the user terminal by the output unit of Figure 2.
Figure 10 is a graph showing the daily silkworm feeding amount and silkworm weight provided to the user terminal by the output unit of Figure 2.

The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely provided to ensure that the disclosure of the present invention is complete and to be understood by those skilled in the art. It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

Hereinafter, the silkworm growth monitoring and environment control system according to embodiments of the present invention will be described with reference to the drawings.

Figure 1 is a schematic diagram of a silkworm growth monitoring and environment control system according to an embodiment of the present invention, and Figure 2 is a detailed diagram of the growth management server of Figure 1.

Referring to FIG. 1, the silkworm growth monitoring and environment control system 10 according to an embodiment of the present invention includes a silkworm growth cage 100, a central control device 200, and a growth management server 300.

The silkworm growth cage 100 includes an image acquisition device 120, a sound acquisition device 140, an environmental information measurement device 160, and an environmental control device 180.

The silkworm growth cage 100 is provided with a space to accommodate silkworms and mulberry leaves, allowing silkworms to grow. For example, the silkworm growth cage 100 may be formed of a bottom plate on which silkworm mulberry leaves can be placed and a plurality of pillars connected to the bottom plate.

The image acquisition device 120 functions to acquire image information by photographing the growth environment of the silkworm growth cage 100.

The image acquisition device 120 is configured to include a camera module and can capture real-time images of the growth environment including silkworms and mulberry leaves in the silkworm growth cage 100 and transmit them to the central control device 200, which will be described later, at preset intervals. A captured image can be created and transmitted to the central control device 200.

The image acquisition device 120 can be installed on a frame such as a pillar of the silkworm growth cage 100 and moves up and down or left and right from the top of the bottom plate of the silkworm growth cage 100 according to a control signal from the central control device 200. It can be installed to enable sliding movement.

For example, the image acquisition device 120 can film the growth environment while sliding up and down or left and right with respect to the silkworm growth cage 100 by a control signal from the central control device 200, and if necessary, the user terminal 400 ) The direction of the camera lens of the camera module of the image acquisition device 120 may be adjusted or the magnification of the camera lens may be controlled according to the control signal transmitted from the.

The sound acquisition device 140 serves to acquire sound information generated from the silkworm growth cage 100 and transmit it to the central control device 200.

The sound acquisition device 140 may be configured to include a microphone module capable of acquiring sound, and may be installed on the frame of the silkworm growth cage 100.

The sound acquisition device 140 may be composed of a separate module from the image acquisition device 120, but may also be formed as a single module to acquire image and sound information simultaneously.

The environmental information measuring device 160 serves to measure environmental information of the silkworm growth cage 100.

For example, the environmental information measuring device 160 may be configured to include a temperature sensor, a humidity sensor, and a carbon dioxide sensor.

The environmental control device 180 serves to control the environment of the silkworm growth cage 100.

For example, the environmental control device 180 may include an air conditioner, a humidifier, a dehumidifier, and a blower.

The central control device 200 serves to control the operation of the image acquisition device 120, the sound acquisition device 140, the environmental information measurement device 160, and the environmental control device 180.

In addition, the central control device 200 collects data from the image acquisition device 120, the sound acquisition device 140, the environmental information measurement device 160, and the environmental control device 180 and transmits it to the growth management server 300. You can.

The central control device 200 is connected to the image acquisition device 120, the sound acquisition device 140, the environmental information measurement device 160, and the environmental control device 180 through a wired or wireless network to control their operation. It may be placed inside or adjacent to the outside of the growth cage 100.

The growth management server 300 is connected to the central control device 200 and the user terminal 400 through a wired or wireless network and transmits silkworm growth status information and silkworm growth environment information to the user terminal 400, and transmits silkworm growth status information and silkworm growth environment information to the user terminal 400. It serves to transmit a control signal to the central control device 200 according to the control request.

The growth management server 300 receives information received from the image acquisition device 120, the sound acquisition device 140, the environmental information measurement device 160, and the environmental control device 180 from the central control device 200, and Growth status information and silkworm growth environment information can be generated and provided to the user terminal 400.

Referring to FIG. 2, the growth management server 300 includes a mulberry leaf distribution rate calculation unit 310, a silkworm growth status information calculation unit 330, a control unit 350, and an output unit 370.

Silkworm growth status information may include information on the amount of mulberry leaves remaining, and the information on the amount of mulberry leaves is analyzed by analyzing at least one of the image information obtained from the image acquisition device 120 and the sound information obtained from the sound acquisition device 140. It can be calculated as follows.

The mulberry leaf distribution rate calculation unit 310 serves to calculate information on the remaining amount of mulberry leaves as described above. The mulberry leaf distribution rate calculation unit 310 can calculate the remaining amount of mulberry leaves using either the collected image information and sound information, or can calculate the remaining amount of mulberry leaves using both pieces of information.

First, a method of calculating the mulberry leaf distribution rate using the image information acquired by the image acquisition device 120 will be described as follows.

The mulberry leaf distribution rate calculation unit 310 calculates the ExG (Excess Green) index based on the RBG data of the collected image information, and uses a binarization algorithm based on the calculated ExG index to divide the collected image information into the mulberry leaf part and other areas. The distribution rate of the mulberry leaf can be calculated by binarizing it into parts and dividing the pixel value of the binarized mulberry leaf area by the total number of pixels in the ROI (Region of Interests) area.

The ExG index can be calculated by Equation 1 below.

In Equation 1, R ^* , G *, B * are RGB color values normalized to values between 0 and 1, R, G, B are the actual color values of the image based on each channel, and R _m , G _m , and B _m are 225, which means the maximum color value of each channel.

At this time, the binarization algorithm may use the Otsh Thresholding algorithm.

By calculating the ExG index and using the Otsu threshold holding method as described above, the mulberry leaf area, which is a green area, can be effectively extracted from image information.

Figure 4 is a diagram showing a real-time captured image provided to the user terminal by the silkworm growth monitoring and environment control system according to an embodiment of the present invention, and Figure 5 is an example diagram of an image processing method of the mulberry leaf distribution rate calculation unit of Figure 2.

The silkworm growth monitoring and environment control system 10 according to an embodiment of the present invention provides real-time image information showing the silkworm growth status of the silkworm growth cage 100 to the user terminal 400, as shown in FIG. 4. You can.

The user terminal 400 may be a terminal such as a desktop computer, laptop, or smartphone, and the growth management server 300 provides a platform that provides real-time image information through an Internet site or application to the user through the user terminal 400. can be provided.

The website or application may be provided with a user interface (UI) for controlling the area of the video image provided in real time, as shown in the lower left part of FIG. 4, and when the user clicks on the UI icon, the image acquisition device (120) ) may be moved up and down or left and right, the direction of the lens of the camera module of the image acquisition device 120 may be changed, or the magnification may be adjusted.

By manipulating the user interface in this way, the user can monitor the breeding status of the desired area in real time.

Figure 5 (a) is a video image of the silkworm growth environment, and (b) shows the image binarized through the Otsu threshold holding binarization algorithm by calculating the ExG index of the image.

When the original image is binarized as shown in (b) of Figure 5, the white area in the entire image area can be determined to be the area where the mulberry leaf is located, and the black area can be determined to be the remaining area. In the image in Figure 5 (b), the mulberry leaf distribution rate was calculated to be 41.91%.

In addition, the mulberry leaf distribution rate calculation unit 310 may calculate the amount of mulberry leaves using sound information received from the sound acquisition device 140.

When a large number of silkworms are gnawing on mulberry leaves at the same time, the gnawing sound can be heard even with human ears. The size of this gnawing sound may vary depending on the amount of mulberry leaves. The present invention builds a database in advance of the sounds generated from the silkworm growth cage 100 according to the amount of mulberry leaves based on the standard number of silkworms, and the sound is measured. By comparing the decibel size of the information with the constructed database, the amount of mulberry leaves remaining can be calculated.

In calculating the amount of remaining mulberry leaves, only the method of analyzing the image information can be used, only the method of analyzing the sound information can be used, or a method that reflects both information can be used.

If both types of information are used, the final value can be calculated by assigning weights to the remaining amount information based on image information and the remaining amount information based on sound information according to preset standards.

When the amount of remaining mulberry leaves is lower than a preset standard value, the growth management server 300 can transmit alarm information indicating that it is feeding time to the user terminal 400 in real time.

The silkworm growth status information calculation unit 330 serves to generate silkworm growth status information based on information received from the image acquisition device 120, the sound acquisition device 140, and the environmental information measurement device 160.

Silkworm growth status information may include the length, width, and weight of the silkworm object, and these values can be calculated in the following manner.

The silkworm growth status information calculation unit 330 detects a silkworm object image using a deep learning-based object detection algorithm from the image information received from the image acquisition device 120, and performs image segmentation on the detected object image. ), binarize the silkworm area and the background area, calculate the number of pixels for the binarized silkworm area, and calculate the number of pixels in the regression equation between the length, width, and weight values of the pre-built actual silkworm object and the number of silkworm pixels. You can calculate the length, width, and weight of the silkworm object by entering .

Figures 6 and 7 are exemplary diagrams of an image processing method of the silkworm growth state information calculation unit of Figure 2.

Figure 6 shows images of silkworm objects each detected through a deep learning-based object detection algorithm, and Figure 7 shows an image in which the silkworm area and background area are binarized through image segmentation for a specific silkworm object.

At this time, the length, width, and weight values of the silkworm object may be the average value of the length, width, and weight values of the identified silkworm objects.

The silkworm growth status information calculation unit 300 may generate silkworm growth status information including the length, width, and weight values of the silkworm object at preset time intervals.

The silkworm growth status information generated in this way can be confirmed in Figures 8 to 10. Figure 8 is a graph showing the daily silkworm feeding amount and silkworm length provided to the user terminal by the output unit of Figure 2, and Figure 9 is a graph showing the daily silkworm feeding amount and silkworm width provided by the output unit of Figure 2 to the user terminal. , and FIG. 10 is a graph showing the daily silkworm feeding amount and silkworm weight provided to the user terminal by the output unit of FIG. 2.

By continuously collecting silkworm growth status information in this way, the silkworm growth monitoring and environmental control system 10 according to an embodiment of the present invention collects big data on silkworm length, width, and weight values by silkworm growth date and feeding amount. can be built.

This big data is built together with the environmental information of the silkworm growth cage 100 to calculate environmental information that optimizes the growth of silkworms, and can more accurately identify silkworm growth stages by growth time. Accordingly, the additional effect of detecting 5-instar, 3-day silkworm objects with various efficacy can also be expected.

The output unit 370 includes silkworm growth status information received from the silkworm growth status information calculation unit 300, image information received from the image acquisition device 120, and temperature, humidity, and carbon dioxide received from the environmental information measurement device 160. It serves to generate silkworm growth status information and silkworm growth environment information based on environmental information such as information and transmit them to the user terminal 400.

The control unit 350 automatically calculates the growth environment control value of the silkworm growth cage 100 according to a preset algorithm based on the information received from the central control device 200 and transmits it to the central control device 200 or sends it to the user. It serves to transmit a control signal to the central control device 200 according to the control request received from the terminal 400.

For example, the control unit 350 may transmit control signals for an air conditioner, a humidifier, and a dehumidifier to the central control device 200. However, in addition to remote control, control is also possible on site. In this case, on-site control may be possible by the user directly manipulating the control panel of the central control device 200 located adjacent to the silkworm growth cage 100.

Figure 3 is a schematic flowchart explaining the operation of an embodiment of the silkworm growth monitoring and environment control system according to an embodiment of the present invention.

The silkworm growth monitoring and environment control system 10 according to an embodiment of the present invention collects image and sound information of the silkworm growth cage 100 (S510) and measures environmental information of the silkworm growth cage 100 (S510) S520).

The amount of remaining mulberry leaves is calculated using at least one of the image information and sound information (S530), and the length, width, and weight of the silkworm are calculated by analyzing the image information (S540).

Once the amount of remaining mulberry leaves is calculated and the length, width, and weight of the silkworm are calculated, these values and the environmental information measured in the silkworm growth cage 100 are combined to generate silkworm growth status and silkworm growth environment information (S550), The generated silkworm growth status and silkworm growth environment information is transmitted to the user terminal 400 (S560).

The growth management server 300 receives a control request from the user terminal 400 (S570) and transmits a control signal to the central control device 200 according to the control request to control the growth environment of the silkworm growth cage 100. Do it (S580).

The present invention can monitor the silkworm growth cage 100 in real time, including video information, and control it on-site or remotely using the above method, and can automatically calculate the silkworm growth status including video information and provide it to the user. By establishing big data, it is possible to control the silkworm growth environment in an optimal state.

Those skilled in the art to which the present invention pertains will understand that the present invention can be implemented in other specific forms without changing its technical idea or essential features. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

10: Silkworm growth monitoring and environmental control system
100: Silkworm growth cage 120: Image acquisition device
140: Sound acquisition device 160: Environmental information measurement device
180: environmental control device 200: central control device
300: Growth management server 310: Mulberry leaf distribution rate calculation unit
330: Silkworm growth status information calculation unit 350: Control unit
370: output unit 400: user terminal

Claims (10)

Silkworm growth cage that can accommodate silkworms and mulberry leaves;
An image acquisition device that acquires image information by photographing the growth environment of the silkworm growth cage;
A sound acquisition device that acquires sound information generated by the silkworm growth cage;
An environmental information measuring device that measures environmental information of the silkworm growth cage;
An environmental control device that controls the environment of the silkworm growth cage;
A central control device that controls the operation of the image acquisition device, the sound acquisition device, the environmental information measurement device, and the environmental control device; and
It includes a growth management server that generates silkworm growth status information and silkworm growth environment information using the image information, the sound information, and the environment information and provides them to the user terminal,
The silkworm growth status information includes the image information acquired from the image acquisition device, and information on the amount of remaining mulberry leaves calculated by analyzing the image information and the sound information,
The growth management server applies preset weights to the amount information of the remaining mulberry leaves calculated by the image information and the amount information of the remaining mulberry leaves calculated by the sound information to determine the final value of the amount of the remaining mulberry leaves. Silkworm growth monitoring and environmental control system, characterized in that According to paragraph 1,
The growth management server calculates the ExG index based on the RGB data of the image information, binarizes the image information into the mulberry leaf and other parts using a binarization algorithm based on the calculated ExG index, and divides the entire ROI area. A silkworm growth monitoring and environmental control system that calculates the mulberry leaf distribution rate by dividing the pixel value of the binarized mulberry leaf area by the number of pixels. According to paragraph 2,
A silkworm growth monitoring and environmental control system, wherein the binarization algorithm is an Otsh Thresholding algorithm. According to paragraph 2,
The growth management server is a silkworm growth monitoring and environment control system that transmits alarm information indicating feeding time to the user terminal when the mulberry leaf distribution rate is lower than a preset reference value. According to paragraph 2,
The growth management server detects a silkworm object image from the image information using a deep learning-based object detection algorithm, binarizes the silkworm area and the background area through image segmentation for the detected silkworm object image, and binarizes the binarized silkworm area. Calculate the number of pixels for
The silkworm growth state information including the length, width, and weight values of the detected silkworm object by inputting the calculated number of pixels into a regression equation between the length, width, and weight values of the actual silkworm object built in advance and the number of silkworm pixels. A silkworm growth monitoring and environmental control system that generates and provides to the user terminal. According to paragraph 2,
The environmental information measuring device is a silkworm growth monitoring and environmental control system including a temperature sensor, a humidity sensor, and a carbon dioxide sensor. According to clause 6,
The environmental control device is a silkworm growth monitoring and environmental control system including an air conditioner, a humidifier, a dehumidifier, and a blower. delete According to paragraph 2,
The growth management server causes the image acquisition device to acquire captured images of the growth environment at a preset cycle through the central control device,
Providing the silkworm growth status information and the silkworm growth environment information by date and time of the silkworm, including the captured image and the amount information of the mulberry leaf, to the user terminal,
A silkworm growth monitoring and environment control system that transmits control commands of the image acquisition device, the environmental information measurement device, and the environmental control device to the central control device in accordance with a control request received from the user terminal. According to clause 9,
The growth management server,
Silkworm growth monitoring that builds big data on the silkworm growth status information, silkworm growth environment information, and amount information of the mulberry leaves by date and time, and establishes a standard value for controlling silkworm growth environment information to increase the growth rate of silkworms, and Environmental control system.