CN110956211B - Multi-mode information fusion-based method in livestock and poultry farm - Google Patents
Multi-mode information fusion-based method in livestock and poultry farm Download PDFInfo
- Publication number
- CN110956211B CN110956211B CN201911200799.8A CN201911200799A CN110956211B CN 110956211 B CN110956211 B CN 110956211B CN 201911200799 A CN201911200799 A CN 201911200799A CN 110956211 B CN110956211 B CN 110956211B
- Authority
- CN
- China
- Prior art keywords
- data
- livestock
- information
- poultry
- layer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A40/00—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production
- Y02A40/70—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in livestock or poultry
Landscapes
- Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a method based on multi-mode information fusion in a livestock farm, which comprises the following steps: acquiring livestock and poultry image modal information, livestock and poultry sound modal information and environment parameter modal information in a livestock and poultry farm; establishing an LPF data format, wherein image mode information is divided into R layer data, G layer data and B layer data for storage, the R layer data, the G layer data, the B layer data, sound data and environment parameter data are sequentially arranged in the data format, and a flag bit is inserted between each data; and extracting the three modal information according to the acquisition time sequence, and carrying out permutation and fusion according to the data format to obtain fusion data. By setting the data format and fusing according to the method, the method can be used for conveniently packaging the information in the livestock and poultry farm, is convenient for subsequent transmission, storage and management, and has the advantages of small storage capacity, large load information quantity, high transmission speed and the like.
Description
Technical Field
The invention relates to the technical field of intelligent livestock and poultry breeding, in particular to a method based on multi-mode information fusion in a livestock and poultry farm.
Background
In recent years, the rapid development of the livestock and poultry raising industry changes the traditional individual household raising mode into a large-scale and intensive livestock and poultry raising field. The livestock and poultry breeding method is changed from the traditional artificial breeding mode to the breeding technical means based on modern methods such as computer technology, internet of things technology and the like. Therefore, a large amount of multi-modal information such as images, sounds, temperature, humidity, etc. is generated during the cultivation process.
At present, the traditional livestock and poultry raising enterprises also adopt a classified transmission mode for multi-mode information, but the traditional single-mode information fusion and transmission method has the defects of large data volume and low transmission speed, and the transmission methods among different modes cannot be mutually used, so that the multi-mode information cannot be well fused, and therefore, the multi-mode information cannot be well managed. How to fuse the multi-mode information more quickly and efficiently becomes the problem that the intelligent management of the livestock and poultry farm must be faced.
Disclosure of Invention
The invention aims to overcome the defects and shortcomings of the prior art and provides a method for fusing multi-mode information in a livestock farm.
The aim of the invention is achieved by the following technical scheme: a method for multi-modal information fusion based in a livestock farm, comprising:
acquiring livestock and poultry image modal information, livestock and poultry sound modal information and environment parameter modal information in a livestock and poultry farm;
establishing an LPF data format, wherein image mode information is divided into R layer data, G layer data and B layer data for storage, the R layer data, the G layer data, the B layer data, sound data and environment parameter data are sequentially arranged in the data format, and a flag bit is inserted between each data;
and extracting the three modal information according to the acquisition time sequence, and carrying out permutation and fusion according to the data format to obtain fusion data.
The invention can merge various modal information by adopting the LPF data format, and can merge the packet heads, the data length and various flag bits of the multi-set modal information data format into a set compared with the traditional mode of independently transmitting the image information of the JPG format, the sound information of the MP3 format and the environment parameter information, thereby effectively reducing the length of the data information and being convenient for the rapid storage and transmission of the multi-modal information.
Preferably, the specific structure of the LPF data format is as follows:
file signature field, file length, file start bit, R layer data, R layer end bit, G layer start bit, G layer data, G layer end bit, B layer start bit, B layer data, B layer end bit, voice data start bit, voice data end bit, environmental parameter data start bit, environmental parameter data end bit, CRC check code, file end bit.
Preferably, the various flag bits are used to identify the locations where various modal information is stored in the LPF file.
Preferably, the file signature field is used to identify whether the file is an LPF file.
Preferably, the environmental parameter information includes temperature information, humidity information, harmful gas concentration, airflow speed, dust concentration, and illumination intensity.
Preferably, the pretreatment is carried out on the images after the livestock and poultry images are acquired, and the pretreatment steps are as follows:
normalizing the livestock and poultry image, uniformly processing the image into an RGB three-channel color livestock and poultry image with fixed resolution, wherein the livestock and poultry image modal information is the RGB three-channel color livestock and poultry image information.
Preferably, after the sound information of the livestock and poultry is obtained, the sound information is preprocessed, and the preprocessing steps are as follows: the sampling rate of the sound information is adjusted to a uniform frequency.
Compared with the prior art, the invention has the following advantages and beneficial effects:
compared with the traditional single data format of image information, sound information and environment parameter information, the novel data format LPF provided by the invention has the advantages of small storage capacity, large load information quantity, high transmission speed and the like. The method fuses three different modal information into a novel modal information for transmission, and is simplified by the multiplication, so that the subsequent management system is convenient for storing and managing the different modal information.
Drawings
Fig. 1 is a flowchart of a method based on multi-mode information fusion in a livestock farm.
Detailed Description
The present invention will be described in further detail with reference to examples and drawings, but embodiments of the present invention are not limited thereto.
Examples
As shown in fig. 1, the present invention provides a method for fusing information based on multiple modes in a livestock farm, which can perform fusion processing on an acquired livestock image, livestock sound and environmental parameter information in the livestock farm, where the fusion processing is implemented by creating a LPF data format.
In this embodiment, a plurality of high-definition cameras and sound sensors are erected in the livestock and poultry house, and meanwhile, a plurality of environment sensors are erected everywhere in the livestock and poultry farm, wherein the environment sensors comprise a temperature sensor, a humidity sensor, a harmful gas concentration sensor, an airflow speed sensor, a dust concentration sensor, an illumination intensity sensor and the like. The method comprises the steps of collecting livestock and poultry images through a high-definition camera, collecting livestock and poultry sound modal information through sound sensors, and collecting environment parameter modal information in a livestock and poultry farm through each environment sensor.
For the obtained livestock and poultry image, preprocessing is carried out on the image, the livestock and poultry image is uniformly processed into RGB three-channel color livestock and poultry image information with the resolution of 800 x 600, and the RGB three-channel information corresponds to R layer data, G layer data and B layer data in a subsequent data mode.
And preprocessing the obtained livestock and poultry sound, and uniformly adjusting the sampling rate of the livestock and poultry sound information to 44100Hz.
For the obtained environmental parameter information, in practical application, in order to facilitate the receiving and identifying of the subsequent server, the data collected by each sensor are sequentially arranged and stored.
After the data are correspondingly preprocessed and sequenced, three mode information are fused, and the fusion method is as follows:
a data format (LPF) is constructed, wherein the data format is shown in table 1 and comprises a file signature field, a file length, a file start bit, an R layer start bit, R layer data, an R layer end bit, a G layer start bit, G layer data, a G layer end bit, a B layer start bit, B layer data, a B layer end bit, a sound data start bit, a sound data end bit, an environment parameter data start bit, environment parameter data, an environment parameter data end bit, a CRC check code and a file end bit.
TABLE 1 data format
And when fusion is carried out, dividing the image mode information into R layer data, G layer data and B layer data, extracting according to the acquisition time sequence, and carrying out arrangement fusion according to the data format to obtain fusion data. The R layer start flag bit represents a start flag of an R channel of the livestock and poultry image, and the size of the R layer start flag bit is 2 bytes. The R layer data represent the data of the R channel of the livestock and poultry image. The R layer end mark bit represents an end mark of an R channel of the livestock and poultry image, and the size of the R layer end mark bit is 2 bytes. The G layer start flag bit represents a start flag of a G channel of the livestock and poultry image, and the size of the G layer start flag bit is 2 bytes. The layer G data represents the data of the livestock and poultry image G channel. The G layer end flag bit represents an end flag of the G channel of the livestock and poultry image, and the size of the G layer end flag bit is 2 bytes. The B layer start flag bit represents a start flag of a B channel of the livestock and poultry image, and the size of the B layer start flag bit is 2 bytes. The B layer data represents the data of B channel of the livestock and poultry image. The B layer end mark bit represents an end mark of a B channel of the livestock and poultry image, and the size of the B layer end mark bit is 2 bytes. The sound data start flag bit represents a start flag of the sound data of the livestock and poultry, and the size is 2 bytes. The sound data represents livestock sound data. The sound data end flag bit represents an end flag of the sound data of the livestock and poultry, and the size is 2 bytes. The environmental parameter data start flag bit represents an environmental parameter information start flag in the livestock and poultry house, and the environmental parameter data represents environmental parameter information in the livestock and poultry house. The environmental parameter data end flag bit represents an environmental parameter information end flag in the livestock and poultry houses, and the size is 4 bytes. The CRC code represents the check of environmental parameter information in the livestock and poultry houses, and the size is 4 bytes. The end of file flag bit is used to indicate the end of file, and the size is 4 bytes.
While the invention has been described with reference to certain preferred embodiments, it will be understood by those skilled in the art that various changes and substitutions of equivalents may be made and equivalents will be apparent to those skilled in the art without departing from the scope of the invention. Therefore, the protection scope of the invention is subject to the protection scope of the claims.
Claims (6)
1. A method for multi-modal information fusion in a livestock farm, comprising:
acquiring livestock and poultry image modal information, livestock and poultry sound modal information and environment parameter modal information in a livestock and poultry farm;
establishing an LPF data format, wherein image mode information is divided into R layer data, G layer data and B layer data for storage, the R layer data, the G layer data, the B layer data, sound data and environment parameter data are sequentially arranged in the data format, and a flag bit is inserted between each data; the specific structure of the LPF data format is as follows:
file signature field, file length, file start bit, R layer data, R layer end bit, G layer start bit, G layer data, G layer end bit, B layer start bit, B layer data, B layer end bit, voice data start bit, voice data end bit, environmental parameter data start bit, environmental parameter data end bit, CRC check code, file end bit;
and extracting the three modal information according to the acquisition time sequence, and carrying out permutation and fusion according to the data format to obtain fusion data.
2. The method for multi-modal information fusion based on the livestock and poultry farm according to claim 1, wherein various flag bits are used for identifying the storage positions of various modal information in the LPF file.
3. The method of claim 1, wherein the file signature field is used to identify whether the file is an LPF file.
4. The method based on multi-modal information fusion in a livestock farm according to claim 1, wherein the environmental parameter information includes temperature information, humidity information, harmful gas concentration, airflow rate, dust concentration, illumination intensity.
5. The method based on multi-modal information fusion in a livestock farm according to claim 1, wherein the preprocessing of the images after the acquisition of the livestock images is as follows:
normalizing the livestock and poultry image, uniformly processing the image into an RGB three-channel color livestock and poultry image with fixed resolution, wherein the livestock and poultry image modal information is the RGB three-channel color livestock and poultry image information.
6. The method for multi-modal information fusion based on the livestock and poultry farm according to claim 1, wherein after the voice information of the livestock and poultry is obtained, the voice information is preprocessed, and the preprocessing steps are as follows: the sampling rate of the sound information is adjusted to a uniform frequency.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911200799.8A CN110956211B (en) | 2019-11-29 | 2019-11-29 | Multi-mode information fusion-based method in livestock and poultry farm |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911200799.8A CN110956211B (en) | 2019-11-29 | 2019-11-29 | Multi-mode information fusion-based method in livestock and poultry farm |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110956211A CN110956211A (en) | 2020-04-03 |
| CN110956211B true CN110956211B (en) | 2023-06-20 |
Family
ID=69979014
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911200799.8A Active CN110956211B (en) | 2019-11-29 | 2019-11-29 | Multi-mode information fusion-based method in livestock and poultry farm |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110956211B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112595396A (en) * | 2020-11-19 | 2021-04-02 | 华南农业大学 | Automatic weighing system and method for breeding hens in farm |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101470897A (en) * | 2007-12-26 | 2009-07-01 | 中国科学院自动化研究所 | Sensitive film detection method based on audio/video amalgamation policy |
| CN102262440A (en) * | 2010-06-11 | 2011-11-30 | 微软公司 | Multi-modal gender recognition |
| CN205431522U (en) * | 2016-02-24 | 2016-08-10 | 江苏超数信息科技有限公司 | Safe control system is bred to beasts and birds based on cloud calculates |
| CN109685678A (en) * | 2018-12-28 | 2019-04-26 | 广州影子科技有限公司 | Domestic animal intelligence management system for breeding and method based on big data technology |
| CN110083090A (en) * | 2019-04-09 | 2019-08-02 | 华南农业大学 | A kind of livestock and poultry cultivation environmental parameter multipoint wireless intelligent monitor system and its method |
-
2019
- 2019-11-29 CN CN201911200799.8A patent/CN110956211B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101470897A (en) * | 2007-12-26 | 2009-07-01 | 中国科学院自动化研究所 | Sensitive film detection method based on audio/video amalgamation policy |
| CN102262440A (en) * | 2010-06-11 | 2011-11-30 | 微软公司 | Multi-modal gender recognition |
| CN205431522U (en) * | 2016-02-24 | 2016-08-10 | 江苏超数信息科技有限公司 | Safe control system is bred to beasts and birds based on cloud calculates |
| CN109685678A (en) * | 2018-12-28 | 2019-04-26 | 广州影子科技有限公司 | Domestic animal intelligence management system for breeding and method based on big data technology |
| CN110083090A (en) * | 2019-04-09 | 2019-08-02 | 华南农业大学 | A kind of livestock and poultry cultivation environmental parameter multipoint wireless intelligent monitor system and its method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110956211A (en) | 2020-04-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104899261B (en) | A kind of apparatus and method for building structuring video image information | |
| CN102890682B (en) | Build the method, search method, apparatus and system of index | |
| US20200285953A1 (en) | Intelligent recognition and alert methods and systems | |
| CN105516027B (en) | Using identification model method for building up, the recognition methods of data on flows and device | |
| CN108133008A (en) | The processing method of business datum, device, equipment and storage medium in database | |
| WO2016000507A1 (en) | Traffic-saving mode search service method, server, client and system | |
| JP2007094449A5 (en) | ||
| CN110287696B (en) | Detection method, device and equipment for rebound shell process | |
| JP2020533657A (en) | Methods and devices for detecting burr on electrode sheets | |
| CN111191767A (en) | Vectorization-based malicious traffic attack type judgment method | |
| CN101441629A (en) | Automatic acquiring method of non-structured web page information | |
| CN110956211B (en) | Multi-mode information fusion-based method in livestock and poultry farm | |
| CN109446946A (en) | A kind of multi-cam real-time detection method based on multithreading | |
| WO2017107963A1 (en) | Message sending and receiving method and apparatus | |
| CN106790347B (en) | Large-scale concurrent data forwarding method based on netty | |
| SE0201529D0 (en) | Method and apparatus for IR camera inspections | |
| CN111949619A (en) | Dynamic directory generation method, system, electronic device and storage medium | |
| CN100579206C (en) | Method for capturing network audio and video files | |
| JP2002135672A5 (en) | ||
| CN104813610A (en) | Providing multiple content items for display on multiple devices | |
| CN107070860A (en) | A kind of collection method of monitoring data, device and system | |
| CN105939364A (en) | Intelligent message push method and system | |
| CN101888303A (en) | Recording method of network traffic information and related device | |
| CN109905430A (en) | A kind of method for upgrading software and system | |
| US20050052535A1 (en) | Context sensitive camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Zhang Tiemin Inventor after: Fang Cheng Inventor after: Zheng Haikun Inventor before: Zhang Tiemin Inventor before: Fang Cheng Inventor before: Zheng Haikun |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |