KR20230052170A - Apparatus and method for monitoring inactive livestock - Google Patents

Abstract

Disclosed is a monitoring method for visualizing a location of inactive livestock within a livestock farm. The monitoring method comprises the steps of: extracting, by an image analysis device, livestock objects from video images acquired for each frame, and then calculating center coordinates representing a location of inactive livestock within a livestock barn based on coordinates of an extracted livestock objects; displaying, by a display device, an object icon representing the inactive livestock in a display area mapped to calculated center coordinates among a plurality of display areas defined on a display screen; and emitting light by lighting units selected from among a plurality of lighting units installed in a livestock structure based on the calculated center coordinates. Accordingly, livestock management can be managed efficiently.

Description

Apparatus and method for monitoring inactive livestock

The present invention relates to an apparatus and method for monitoring inactive livestock showing signs of abnormality in a barn.

Video-based monitoring technology is generally used as a method of monitoring inactive livestock (abnormal livestock) in the barn. For example, a camera sensor is installed on the ceiling or side of the barn, and the barn manager analyzes the livestock image acquired by the installed camera sensor to monitor the status, movement and posture of the livestock.

However, in the case of photographing livestock in a barn, for example, a large number of pigs gathered in a herd form using a camera sensor installed at a fixed location, the camera sensor is an inactive pig covered by an active pig (normal pig) ( Abnormal pigs) may not be photographed. That is, there may be cases in which inactive pigs with abnormal signs cannot be monitored through images.

An object of the present invention to solve the above problems is to provide a device and method for more easily monitoring the inactive livestock by visualizing the location of the inactive livestock showing abnormal signs so that the barn manager can intuitively recognize the location of the inactive livestock. is to do

In order to achieve the above object, a monitoring method for visualizing the location of inactive livestock in a barn includes extracting livestock objects from video images acquired for each frame; calculating center coordinates representing the location of the inactive livestock based on the coordinates of the extracted livestock objects; and displaying an object icon representing the inactive livestock in a display area mapped to the calculated center coordinates among a plurality of display areas defined on a display screen.

In another monitoring method, the video analysis device extracts livestock objects from video images acquired for each frame, and then calculates center coordinates indicating the location of inactive livestock within the barn based on the coordinates of the extracted livestock objects. doing; displaying, by a display device, an object icon representing the inactive livestock in a display area mapped to the calculated center coordinates among a plurality of display areas defined on a display screen; and emitting light of light units selected from among a plurality of lighting units installed in the barn structure based on the calculated center coordinates.

A monitoring device for visualizing the location of an inactive livestock in a barn includes: a video camera device that photographs the livestock in the barn and acquires video images including livestock objects for each frame; an image analysis device that extracts livestock objects from the video image and calculates center coordinates representing the location of inactive livestock within the barn based on the coordinates of the extracted livestock objects; a display device displaying an object icon representing the inactive livestock in a display area mapped to the calculated center coordinates among a plurality of display areas defined on a display screen; a lighting device installed on a boundary structure within the barn and including lighting units selected from among the plurality of lighting units to emit light according to the calculated center coordinates; and a meter reading device for measuring biometric information of the inactive livestock present in a location intuitively recognized by the livestock farm manager through the display area where the object icon is displayed and the illuminated lighting units.

According to the present invention, a farm manager can intuitively recognize the location of inactive livestock showing abnormal symptoms through a display device and a lighting device installed in the barn, and check the state of the inactive livestock through a meter reading device to confirm the location. By automatically sending the results to an external management system, livestock management can be managed efficiently.

1 is a schematic configuration diagram of an apparatus for monitoring inactive pigs according to an embodiment of the present invention.
FIG. 2 is a flow diagram illustrating a method for monitoring inactive pigs using the device shown in FIG. 1;
FIG. 3 is a diagram for explaining the structure and operation of the meter reading device shown in FIG. 1;
FIG. 4 is a diagram illustrating an example of a configuration of a screen displayed by the display device shown in FIG. 1 .
5 is a detailed configuration diagram of the video analysis device shown in FIG. 1 .
FIG. 6 is a diagram for explaining a clustering process performed by the clustering processing unit shown in FIG. 5 .

Terms used in this specification are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention will be described in more detail. In order to facilitate overall understanding in the description of the present invention, the same reference numerals are used for the same components in the drawings, and redundant descriptions of the same components are omitted.

1 is a schematic configuration diagram of an apparatus for monitoring inactive livestock according to an embodiment of the present invention.

Referring to FIG. 1 , the monitoring device according to an embodiment of the present invention provides a function to more easily monitor the inactive livestock by visualizing the position of the inactive livestock in a barn to intuitively recognize.

In the present specification, the barn is described as being limited to a facility for breeding pigs, but this is not intended to limit the monitoring target to pigs. The inside of the barn can be divided into a number of zones for accommodating pigs, one zone is shown in FIG. 1 .

A device according to an embodiment of the present invention for monitoring inactive pigs includes a video camera device 113, an image analysis device 114, a display device 106, a lighting device 104, and a meter reading rod device 105. do.

The video camera device 113 is installed at the upper part of the barn and acquires video information including a plurality of pig objects by photographing the pigs 109 and 110 accommodated in each area.

The video analysis device 114 analyzes the image information input from the video camera device 113 to generate an image analysis result including location information of the inactive pigs 110 showing abnormal symptoms, and displays the result of the image analysis (106). ) is sent to The display device 106 may be connected to the image analysis device 114 by wire in order to receive an image analysis result from the image analysis device 114 .

The video analysis device 114 may transmit the video analysis result or the location information of the inactive pig 110 included in the video analysis result to an external management system.

The image analysis device 114 includes a processor including at least one CPU and/or at least one GPU capable of executing and processing various image processing algorithms to analyze image information from the image camera device 113, such a processor It may be implemented as a computer device including a memory and a communication module for temporarily storing the intermediate data and result data processed by the.

The display device 106 may be installed on the boundary structure 10 defining each area partitioned within the barn by means of a fixing member 107 manufactured in an arbitrary shape. The display device 106 displays the location of the inactive pigs 110 showing signs of abnormality among the pigs 109 and 110 according to the image analysis result received from the image analysis device 114 .

The lighting device 104 includes a plurality of lighting units 104 - 1 to 104 - 8 installed on the boundary structure 10 and receives an image analysis result from the image analysis device 114 . The lighting device 104 may be connected to the image analysis device 114 by wire or wirelessly in order to receive an image analysis result from the image analysis device 114 .

Some of the lighting units 104-1, 104-2, and 104-3 among the plurality of lighting units 104-1 to 104-8 use location information of the inactive pigs 110 included in the image analysis result. It can operate to emit light accordingly.

The illuminated light units 104-1, 104-2 and 104-3 may be light units located at vertex coordinates of a virtual triangle area including the positions of the inactive pigs 110. there is.

As the positions of the inactive pigs 110 are visually displayed by the display device 106 and the lighting device 104, the barn manager 108 can intuitively recognize the positions of the inactive pigs 110. there is.

Meanwhile, each lighting unit may be, for example, a visible light wireless communication (VLC) based LED lighting unit having a beacon sensor or a beacon chip embedded therein. Here, visible light wireless communication refers to a communication technology that uses visible light as a medium. Since the present invention is not characterized by visible light wireless communication, the description thereof is replaced with known technology.

The meter reading device 105 includes a communication module that communicates with the lighting device 104 according to the VLC communication method according to the visible light wireless communication (VLC) method and a sensor module capable of measuring the vital signs of the inactive pigs 110. do. The structure and operation of the meter reading device 105 will be described later with reference to FIG. 3 .

FIG. 2 is a flow chart illustrating a method for monitoring inactive pigs using the device shown in FIG. 1 .

Referring to FIG. 2, the method for monitoring inactive pigs can be largely divided into a photographing step (S101), an analysis step (S102), a notification step (S103), and a confirmation step (S104). , divided into four stages, but not intended to be limiting. Therefore, each step may be subdivided into several steps within a range easily expected by those skilled in the art from the description below, or some steps may be integrated into one step.

First, in the photographing step S101, the video camera 113 photographs the pigs in the barn to obtain image information on the pigs.

Next, in the analysis step (S102), the video analysis device 114 analyzes the image information obtained by the video camera device 113 to determine the abnormal state of the pigs.

Subsequently, in the notification step (S103), the display device 106 visually displays the locations of the inactive pigs 110 according to the image analysis result from the image analysis device 114.

In addition, in the notification step (S103), some of the lighting devices 104-1, 104-2, and 104-3 included in the lighting device 104 (104-1 to 104-8) are sent from the image analysis device 114. It operates to emit light according to the result of image analysis. At this time, some of the lighting devices 104-1, 104-2, and 104-3 may be lighting units located at the vertices of the virtual triangular area including the position of the inactive pig 110 identified according to the image analysis result. .

Subsequently, in the confirmation step (S104), the barn manager 108 sends a notification message notifying the appearance of an inactive pig showing abnormal signs through his or her user terminal (eg, smart phone, etc.) or personal computer to the video analysis device 114. ) A process of receiving from may be performed. Here, the user terminal (eg, smart phone, etc.) or personal computer of the barn manager 108 connects the video analysis device 114 with a wired or wired or Can communicate wirelessly.

In addition, in the confirmation step (S104), when the barn manager 108 confirms the notification message, he carries the meter reading device 105, moves to the barn, and shows the inactive pigs 110 through the display device 106. A process of intuitively confirming the location is performed.

In addition, in the confirmation step (S104), the barn manager 108 determines the location of the inactive pigs 110 through the virtual triangular area formed by the lighted lighting units 104-1 to 104-3. An intuitive confirmation process is performed.

In addition, in the confirmation step (S104), the barn manager 108 intuitively uses the display device 106 and/or the lighting device 104 to check the activity (vital signs) of the inactive pigs 110. A process of measuring the biosignal of the inactive pig 110 present at the position recognized by the meter reading device 105 is performed.

In addition, in the confirmation step S104, the meter reading device 105 configures the location information of the lighting device 104 acquired through visible light wireless communication with the lighting device 104 as the location information of the meter reading device 105, and reads the meter. Location information of the device 105 may be transmitted to an external management system via the video analysis device 114 . Here, the meter reading device 105 may directly transmit the location information of the meter reading device 105 to an external management system without directly passing through the image analysis device 114 . In this case, when the external management system is located in a short distance, the meter reading device 105 and the external management system may communicate according to a short-range wireless communication method, and when the external management system is located in a long distance, the meter reading device 105 is a barn manager. The user terminal of (108) can be used as an intermediate medium to communicate with an external management system. In this case, the meter reading device 105 and the user terminal may communicate according to a ground wireless communication method, and the user terminal and the external management system may communicate through a mobile communication network.

FIG. 3 is a diagram for explaining the schematic structure and operation of the meter reading device shown in FIG. 1;

Referring to FIG. 3, the meter reading device 105 includes a stick body 105-1 extending in a straight line, a sensor module 105-2 installed at one end of the stick body 105-2, and the It may be configured to include a communication module 105-3 installed at the other end of the rod body 105-1.

The barn manager 108 intuitively checks the virtual triangular area 201 formed by the illuminated lighting units 104-1, 104-2 and 104-3, and then A biosignal 105-4 of the pig 110 located in the virtual triangular area 201 is measured using a sensor module 105-2 installed at one end.

When the sensor module 105-2 measures a biosignal indicating inactivity from the pig 110, the measured biosignal is processed and processed into biometric information, and the processed biometric information is converted to the rod body 105. It is transmitted to the communication module 105-3 installed at the other end of -2). In this case, the communication module 105-3 may be connected to the sensor module 105-2 by wire and/or wirelessly and configured to receive the biometric information from the sensor module 105-2.

In addition, the communication module 105-3 receives a VLC message according to a visible light wireless communication (VLC) method with at least one lighting unit among the light units 104-1, 104-2, and 104-3 that emit light. . The VLC message includes location information of the lighting unit.

In addition, the communication module 105-3 configures the location information of the lighting unit received from at least one lighting unit as location information of the meter reading device 105 (or location information of the measurement manager 108), Location information of the meter reading device 105 may be transmitted to the image analysis device 114 together with the biometric information. The video analysis device 114 may transmit biometric information of an inactive pig and location information of the meter reading device 105 received from the communication module 105-3 to an external management system.

In order to transmit the biometric information of the inactive pig and the location information of the meter reading device 105 to the image analysis device 114, the communication module 105-3 includes a wireless communication module 31 and the wireless communication module 32 ) It includes a control unit 32 that controls the operation of. Additionally, the communication module 105-3 may further include a VLC module 33 supporting visible light wireless communication (VLC).

The wireless communication module 31 transmits biometric information of the inactive pig and location information of the meter reading device 105 to the image analysis device 114 under the control of the controller 32 .

The VLC module 33 transmits the VLC message including location information of the emitted light units from the light units 104-1, 104-2 and 104-3 according to the control of the control unit 32. is received, and the location of the meter reading device 105, that is, the location of the barn manager 108, can be grasped through this VLC message.

Meanwhile, in order to measure the precise position of the meter reading device 105, an indoor positioning technique based on visible light wireless communication may be used. For example, the control unit 32 includes the coordinate values and each coordinate value received from the lighting units 104-1, 104-2 and 104-3 through the VLC module 33, respectively. The position of the meter reading device 105 can be precisely measured according to a triangulation technique using the received signal strength value (RSSI) of the VLC signal to be measured. For reference, the location coordinates of the meter reading device 105 according to the triangulation technique use each coordinate value as a center point, and the distance value (distance from the VLC module 33 to each lighting unit) according to the received signal strength value (RSSI) value) as a radius, and then may be positional coordinates indicating an intersection of the calculated three circles.

As described above, the barn manager 108 determines the position of the inactive pig displayed by the display device 106 and the virtual triangle formed by the illuminated lighting units 104-1, 104-2 and 104-3. Through the region 201, the position of the inactive pig 110 showing abnormal symptoms can be intuitively recognized.

Thereafter, the barn manager 108 approaches the sensor module 105-2 of the meter reading device 105 toward the pig 110 showing abnormal signs in order to actually check the abnormal symptoms of the inactive pig 110, and then The biological signal of the pig 110 is measured, and the communication module 105 - 3 of the meter reading device 105 transmits the measurement result (biological information) to the image analysis device 114 . Then, the video analysis device 114 transmits the location information of the inactive pig 110, the biometric information of the inactive pig received from the meter reading device 105, and the location information of the meter reading device 105 to an external management system.

FIG. 4 is a diagram showing the position of an inactive pig shown through the display screen of the display device shown in FIG. 1 .

Referring to FIG. 4 , as described above, the video analysis device 114 analyzes the video information transmitted from the video camera device 113 to detect location information of an inactive pig, and displays the information to the display device 106. send each

The display device 106 displays the location information of the inactive pig received from the video analysis device 114 as an object icon having a specific shape (eg, a circle shape). A plurality of display areas are partitioned in a matrix form on the display screen of the display device 106, and the ratio between the display areas A and B mapped to the positions of the inactive pigs 41 and 42 among the plurality of display areas is Object icons 41' and 42' representing active pigs 41 and 42 are displayed. At this time, in order to increase visibility, the object icon may be displayed in a flickering form.

Also, as described above, lighting units positioned at the vertices of the virtual triangular area including the location of the inactive pig among a plurality of lighting units emit light so that the barn manager can intuitively recognize the location of the inactive pig through the lighting device. .

When the video analysis device 114 analyzes the image information and detects the first location information of the first inactive pig 41 and the second location information of the second inactive pig 42, the first location information The lighting units 41A, 41B, and 41C positioned at the vertices of the virtual triangular area 201 including the included position values emit light, and the second position information of the virtual triangular area 202 including the position values includes the As the lighting units 42A, 42B, and 42C located at the vertices emit light, the barn manager lights the inactive pigs 41, 42 by the light-emitting operation of the lighting units 41A, 41B, 41C, 42A, 42B, and 42C. ) can be intuitively recognized.

Meanwhile, in the present embodiment, an example in which three lighting units emit light is described so that the barn manager can intuitively recognize the position of one inactive pig, but the present invention can be applied even when two lighting units emit light. can

If the two lighting units are illuminated, the barn manager would expect an inactive pig to be located on an imaginary line connecting the two lighting units. When a plurality of pigs are located on a virtual line, the barn manager may not be able to intuitively recognize which pig is an inactive pig, but the barn manager can simultaneously view the location of the inactive pig displayed by the display device 106. Referring to this, it will be easy to recognize which pig is an inactive pig among a plurality of pigs located on a virtual line. Therefore, the present invention can be sufficiently applied even when two lighting units emit light.

5 is a detailed configuration diagram of the video analysis device shown in FIG. 1 .

First, referring to FIG. 5 , the image analysis device 114 includes an object detection unit 401, a coordinate conversion unit 402, a memory unit 403, a clustering processing unit 404, a display control unit 405, and a lighting control unit 406. ), a visible light wireless communication unit 407, a wireless communication unit 408, an integrated control unit 409, and a wired/wireless communication unit 410.

The object extraction unit 401 extracts pig object information frame by frame from video information (video image) obtained by the video camera device 113 . Here, the pig object information includes the pig object image from which the background is removed and the coordinates of the pig object included in the pig object image.

Known image processing algorithms, such as a background removal algorithm for removing a background image from a video image, an object extraction algorithm for extracting an object in a video image, an object tracking algorithm for tracking the movement of the extracted object, and the like, for extraction of pig object information. this can be used

The coordinate conversion unit 402 converts the coordinates of the pig object extracted by the object extraction unit 401 into coordinates that can be expressed in the screen coordinate system used by the display device 106 by using a known coordinate conversion algorithm. Since the coordinates of the pig object extracted by the object extraction unit 401 are coordinates expressed in the camera coordinate system, in order to map them to the display screen of the display device 106, the coordinates of the pig object are converted into expressible coordinates in the screen coordinate system. Should be.

The memory unit 403 includes a volatile memory and a non-volatile memory, and the coordinates of the pig object converted by the coordinate conversion unit 402 are stored in frame units in the memory unit 403 .

The clustering processing unit 404 clusters coordinates representing the movement of an inactive pig among the coordinates of the pig object stored in the memory unit 403 on a frame-by-frame basis using a clustering algorithm, and the center coordinates of the clustered coordinates. Calculate Here, the center coordinate may be, for example, a coordinate indicating an average of the clustered coordinates.

The display control unit 405 determines the number of display areas mapped to the center coordinates among a plurality of display areas arranged in a matrix form on the display screen of the display device 106 according to the center coordinates input from the clustering processing unit 404. A control signal for controlling the display operation is generated and transmitted to the display device 106 . Here, the control signal may include row and column address data representing addresses of the display area mapped to the center coordinates and output timing data of an object icon displayed on the display area.

The display device 106 displays an object icon representing an inactive pig in a display area mapped to the center coordinates according to the control signal. At this time, in order to increase the visibility of the object icon, the object icon displayed in the display area is displayed in a blinking form according to the determined output timing data.

The lighting control unit 406 includes at least three lighting units selected from among a plurality of lighting units 104-1 to 104-8 included in the lighting device 104 according to the center coordinates input from the clustering processing unit 404. A dimming control signal for controlling a dimming operation of s is generated.

In order to select the at least three lighting units, first, the lighting control unit 406 selects three coordinates among the coordinates of all lighting units installed in the boundary structure (10 in FIG. A triangular area connecting the selected three coordinates is created on the image, and it is determined whether the center coordinates exist in the created triangular area.

When the center coordinates exist within the generated triangular area, the lighting controller 406 generates dimming control signals for three lighting units corresponding to the selected three coordinates.

If the center coordinates do not exist in the created triangular area, the lighting controller 406 creates another triangular area connecting the selected three coordinates, and then the center coordinates in the other triangular area It is determined whether or not there exists, and this determination process is repeated until a triangular area including (surrounding) the center coordinates is detected.

Meanwhile, when the number of triangular areas including the center coordinates is plural, the lighting controller 406 selects a triangular area having the smallest area, and dims lighting units corresponding to the vertex coordinates of the selected triangular area. generate control signals.

The reason for selecting the triangular area with the smallest area is to reduce the area of the virtual triangular area formed in the dimming operation of the lighting units so that the barn manager can more accurately and intuitively recognize the position of the inactive pig. .

The visible light wireless communication unit 407 configures the dimming control signal input from the lighting control unit 406 as a visible light wireless communication (VLC) message, and converts the configured visible light wireless communication (VLC) message into the selected 3 signals according to a visible light wireless communication method. to the number of light units.

The selected three lighting units emit light according to the visible light wireless communication (VLC) message received from the visible light wireless communication unit 407, and the barn manager uses a virtual triangular area formed by the three light-emitting lighting units to emit light. The position of the active pig can be intuitively recognized.

The wireless communication unit 408 receives biometric information of an inactive pig and location information of the meter reading device 105 from the communication module 105-3 of the meter reading device 105 using a wireless communication method. Here, the wireless communication method may be, for example, Wi-Fi or Bluetooth communication.

The integrated control unit 409 transmits biometric information of an inactive pig and location information of the meter reading device 105 received through the wireless communication unit 408 to the wired/wireless communication unit 410 . At this time, the integrated control unit 409 may process biometric information of the inactive pig and location information of the meter reading device 105 as necessary and transmit the information to the wire/wireless communication unit 410 .

The wired/wireless communication unit 410 transmits the biometric information of the inactive pig and the location information of the meter reading device 105 transmitted from the integrated control unit 409 to the external management system 500 in a wired and/or wireless communication method, The external management system 500 stores biometric information of inactive pigs and location information of the meter reading device 105 received from the wired/wireless communication unit 410 in a database and uses them as management data necessary for pig farm operation.

On the other hand, the integrated controller 409 controls and manages the overall operation of the peripheral components 401 to 408 and 410 included in the image analysis device 114, and for this purpose, a microcontroller manufactured to include at least one CPU. It may be a unit (MCU).

The configurations 410 to 410 shown in FIG. 5 are only classified by function to help the understanding of the description, and the video analysis device 114 of the present invention includes the configurations 410 to 410 shown in FIG. It is not intended to necessarily limit the inclusion. In some cases, some components may be integrated into one configuration. For example, the object extraction unit 410, the coordinate conversion unit 402, the memory unit 403, and the clustering processing unit 404 may be embedded in the integrated control unit 409, and a visible light wireless communication unit having a communication function ( 407), the wireless communication unit 408, and the wired/wireless communication unit 410 may be integrated into one communication module.

In addition, some of the components 410 to 410 shown in FIG. 5 may be mounted on a separate device physically separated from the image analysis device 114 . In addition, some of the components 410 to 410 shown in FIG. 5, for example, the object extraction unit 410, the coordinate conversion unit 402, the memory unit 403, and the clustering processing unit 404 are at least It may be implemented as a software module executed by one CPU, at least one GPU, or an integrated control unit.

FIG. 6 is a diagram for explaining a clustering process performed by the clustering processing unit shown in FIG. 5 .

Referring to FIG. 6 , it is assumed that an active pig 109 moves along a moving path R. The center coordinates 9 of the active pig 109 extracted from the video image of the N-1 frame are mapped to 9-1 on the display screen of the display device 106, and the active pig extracted from the video image of the N-th frame The center coordinate (9) of (109) is mapped to 9-2 on the display screen according to the movement of the active pig (109). In addition, the center coordinates 9 of the active pig 109 extracted from the video image of the N+1th frame are mapped to 9-3 on the display screen according to the movement of the active pig 109. As such, the center coordinates 9-1 to 9-3 of the active pig 109 appearing over three frames are widely distributed on the display screen.

On the other hand, since the movement of the inactive pig is not active, the center coordinates 10-1 to 10-3 of the active pig 109 appearing over three frames are densely distributed on the display screen. Coordinates of inactive pig objects may be clustered according to the clustering process.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concept of the present invention defined in the following claims are also included in the scope of the present invention. that fall within the scope of the right.

Claims (18)

As a monitoring method for visualizing the location of inactive livestock in a barn,
Extracting livestock objects from video images obtained for each frame;
calculating center coordinates representing the location of the inactive livestock based on the coordinates of the extracted livestock objects; and
Displaying an object icon representing the inactive livestock in a display area mapped to the calculated center coordinates among a plurality of display areas defined on a display screen.
A method for monitoring inactive livestock comprising a. In paragraph 1,
After displaying an object icon representing the inactive livestock,
After the livestock farm manager intuitively recognizes the location of the inactive livestock based on the display area where the object icon is displayed, the livestock farm manager moves a meter reading device to the intuitively recognized location of the inactive livestock; and
After the meter reading device measures the biometric information of the inactive livestock, transmitting the measured biometric information to an external management system.
A method for monitoring inactive livestock further comprising a. In paragraph 1,
The step of calculating the center coordinates representing the location of the inactive livestock,
clustering coordinates indicating movements of inactive livestock among coordinates of the extracted livestock objects based on a clustering algorithm; and
Calculating center coordinates of the clustered coordinates
A method for monitoring inactive livestock comprising a. In paragraph 3,
Calculating the center coordinates of the clustered coordinates,
The method for monitoring inactive livestock, which is the step of calculating the center coordinates representing the average of the clustered coordinates. In paragraph 3,
Prior to clustering the coordinates,
Based on a coordinate conversion algorithm, the method for monitoring inactive livestock further comprising converting the coordinates of the extracted livestock objects expressed in the camera coordinate system into displayable coordinates in the screen coordinate system. As a monitoring method for visualizing the location of inactive livestock in a barn,
extracting, by an image analysis device, livestock objects from video images acquired for each frame, and then calculating center coordinates indicating a location of an inactive livestock within the barn based on coordinates of the extracted livestock objects;
displaying, by a display device, an object icon representing the inactive livestock in a display area mapped to the calculated center coordinates among a plurality of display areas defined on a display screen; and
emitting light from light units selected from among a plurality of light units installed in the barn structure based on the calculated center coordinates;
A method for monitoring inactive livestock comprising a. In paragraph 6,
The step of emitting light of the selected lighting units,
The step of emitting light of three lighting units located at vertex coordinates of the triangular area including the calculated center coordinate among the plurality of lighting units. In paragraph 6,
The step of emitting light of the selected lighting units,
Receiving, by the selected lighting units, a dimming control signal from the image analysis device according to a visible light wireless communication method; and
emitting light from the selected lighting units according to the dimming control signal;
A method for monitoring inactive livestock comprising a. In paragraph 6,
The step of emitting light of the selected lighting units,
generating, by a lighting control unit included in the image analysis device, a triangular area by connecting three coordinates selected from coordinates of the plurality of lighting units expressed on a two-dimensional plane coordinate system;
determining whether the center coordinates exist within the triangular area;
generating a dimming control signal for controlling light emitting operations of three lighting units corresponding to the three coordinates when the center coordinates exist within the triangular area;
generating, by a visible light wireless communication unit included in the image analysis device, a visible light wireless communication message including the dimming control signal, and transmitting the message to the selected lighting units; and
Step of the selected lighting units emitting light according to the visible light wireless communication message transmitted from the visible light wireless communication unit
A method for monitoring inactive livestock comprising a. In paragraph 6,
After the lighting units emit light,
intuitively recognizing the location of the inactive livestock based on a display area where the object icon is displayed and a virtual triangular area formed by the illuminated lighting units;
moving the meter reading device to the intuitively recognized location of the inactive livestock by the barn manager; and
After the meter reading device measures the biometric information of the inactive livestock, transmitting the measured biometric information to an external management system.
A method for monitoring inactive livestock comprising a. In paragraph 10,
After the meter reading device measures the biometric information of the inactive livestock, the step of transmitting the measured biometric information to an external management system,
transmitting, by the meter reading device, the biometric information to the image analysis device according to a wireless communication method; and
Transmitting, by the image analysis device, the biometric information received from the meter reading device to an external management system according to a wired or wireless communication method
A method for monitoring inactive livestock comprising a. In paragraph 6,
The step of calculating the center coordinates representing the location of the inactive livestock,
clustering coordinates indicating movements of inactive livestock among coordinates of the extracted livestock objects based on a clustering algorithm; and
Calculating center coordinates of the clustered coordinates
A method for monitoring inactive livestock comprising a. A video camera device that acquires video images including livestock objects for each frame by photographing livestock in the barn;
an image analysis device that extracts livestock objects from the video image and calculates center coordinates representing the location of inactive livestock within the barn based on the coordinates of the extracted livestock objects;
a display device displaying an object icon representing the inactive livestock in a display area mapped to the calculated center coordinates among a plurality of display areas defined on a display screen;
a lighting device installed on a boundary structure within the barn and including lighting units selected from among the plurality of lighting units to emit light according to the calculated center coordinates; and
A meter reading device for measuring biometric information of the inactive livestock present in a position intuitively recognized by the livestock farm manager through the display area where the object icon is displayed and the illuminated lighting units.
Device for monitoring inactive livestock comprising a. In paragraph 13,
The meter reading device,
a rod body extending in a straight line;
a sensor module installed at one end of the rod body to measure biometric information of the inactive livestock; and
A communication module installed at the other end of the rod body to transmit the biometric information to the image analysis device according to a wireless communication method.
Device for monitoring inactive livestock comprising a. In paragraph 13,
The video analysis device,
an object detection unit extracting livestock objects from the video images based on an object extraction algorithm;
a clustering processing unit which clusters coordinates indicating movement of the inactive livestock among the coordinates of the extracted livestock objects based on a clustering algorithm, and calculates center coordinates of the clustered coordinates;
a display control unit controlling the display device to display the object icon in a display area mapped to the calculated center coordinates;
a lighting controller configured to generate a dimming control signal for controlling dimming operations of the selected lighting units according to the calculated center coordinates; and
A visible light wireless communication unit transmitting the dimming control signal to the selected lighting units according to a visible light wireless communication method.
Device for monitoring inactive livestock comprising a. In clause 15,
The video analysis device,
Based on a coordinate conversion algorithm, the device for monitoring inactive livestock further comprising a coordinate conversion unit that converts the coordinates of the extracted livestock objects into coordinates that can be expressed in a screen coordinate system. In paragraph 15,
The video analysis device,
a first communication unit which receives the biometric information measured by the meter reading device according to a wireless communication method;
a second communication unit that transmits the biometric information received through the wireless communication unit and information related to the central coordinate indicating the location of the inactive livestock to an external management system according to a wired or wireless communication method; and
Integrated controller for controlling the operation of the first and second communication units
A device for monitoring inactive livestock further comprising a. In clause 15,
The lighting control unit,
After creating a triangular area by selecting three coordinates from among the coordinates of the plurality of lighting units expressed on a two-dimensional plane coordinate system, if the center coordinates exist in the triangular area, they correspond to the vertex coordinates of the triangular area. A device for monitoring inactive livestock that controls the dimming operation of the lighting units used.

Images