CN114330546A - Multi-element sensing device, system and method - Google Patents

Abstract

The invention provides a multi-element sensing device, a system and a method. The sensor module is used for sensing the state information of the monitored object and generating sensing data, and the sensing data comprises at least one of sound, light, electricity, force field signals and position field signals. The communication unit is used for performing communication with an external device. The system comprises a multi-element sensing device and a server, wherein the server and/or a cloud database can be communicated with the multi-element sensing device and is configured to process the sensing data so as to judge whether a monitored object is in a normal operation state. The method adopts the system. The invention can simultaneously and specifically sense three signals of sound, light and electricity, can monitor various signals, and can efficiently solve the technical problems of various signal detection and data acquisition.

Description

Multi-element sensing device, system and method

Technical Field

The invention relates to the technical field of monitoring, in particular to a multi-element sensing device, a multi-element sensing system and a multi-element sensing method.

Background

Conventional monitoring techniques are based on a single detection and processing of visual or acoustic elements or vibration and displacement elements. However, in the application scene of practical industrial and agricultural monitoring, the image, the video, the sound field, the electromagnetic field, the vibration displacement deformation field and the change data fusion of temperature and humidity can help to determine the position and the state of the monitored equipment or the object more efficiently. In many cases, the system state and the positioning system problem cannot be easily, rapidly, accurately and specifically interpreted only by a single signal source, and the cost and difficulty of system integration, operation and maintenance are increased by the multi-element multi-dimensional sensors.

Disclosure of Invention

The present invention is directed to solving at least one of the above-mentioned deficiencies of the prior art, for example, the current monitoring technology is usually only for a single image element or sound element or vibration and displacement element; for example, the problem that the efficiency of calculation and determination of the state of the object by the single-dimensional sensor is relatively low; for example, the problems of insufficient broadband data transmission capability and insufficient strong electromagnetic interference resistance when data transmission is carried out in monitoring; for example, the cost of the equipment and the construction, operation and maintenance costs thereof are high.

In order to achieve the above object, the present invention provides a multi-element sensing device, which includes a central processing unit, and a sensor module and a communication unit connected to and controlled by the central processing unit, and can participate in local processing of data collected by the sensor. The sensor module is used for sensing state information of a monitored object and generating sensing data, and the sensing data comprises at least one of sound, light, electricity, force field signals and position field signals. The communication unit is used for executing communication with an external device. The sensing data is transmitted to a server and/or a cloud database by the communication unit for processing so as to judge whether the monitored object is in a normal operation process and state; and/or the sensing data is processed in the central processing unit to judge whether the monitored object is in a normal operation process and state, and signals containing the judgment result are transmitted to a server and/or a cloud database through the communication unit.

In another aspect, the present invention provides a multivariate perception system, comprising: the one or more multi-element sensing devices are connected with each other to form a network; and the server and/or the cloud database can be communicated with the one or more interconnected networking multi-element sensing devices and can be configured to process the sensing data to judge whether the monitored object is in a normal operation state.

In another aspect, the present invention provides a multivariate perception method, including: sensing status information of the monitored object and generating sensing data, wherein the sensing data comprises at least one of sound field signals, position field signals and electromagnetic field signals; processing the sensing data and judging whether the monitored object is in a normal operation state; when the monitored object is in a normal operation state, sending state data and signals of the monitored object; and transmitting the state data and the alarm signal of the monitored object when the monitored object is in an abnormal operation state.

Compared with the prior art, the beneficial effects of the invention can include: the multi-element sensing device integrates a plurality of sensors, so that the cost and difficulty of system integration, operation and maintenance are reduced; the self-healing ring optical switching communication module is integrated into the multi-element sensing device, and the wide application requirement of the current industrial Internet of things industry can be responded efficiently, conveniently and systematically. The device has a small appearance, different software and hardware can be configured to adapt to different scenes, and the cost is saved; the sensing system has the sensing capability on four signals of sound, light, electricity and force, can monitor various signals such as position and displacement, can efficiently solve the technical problems of detection and data acquisition of various signals, and simultaneously improves the judgment and operation efficiency of the sensing system due to the complementary property of the multidimensional multi-element array signal.

Drawings

FIG. 1 shows a schematic diagram of a multivariate perception device in an example embodiment of the invention;

FIG. 2 shows a schematic diagram of a multivariate sensing device in an exemplary embodiment of the invention;

FIG. 3 shows an exploded view of FIG. 2;

FIG. 4 shows a schematic diagram of a multivariate perception system of an exemplary embodiment of the invention;

FIG. 5 shows a schematic diagram of a multivariate perception system according to an exemplary embodiment of the invention.

The labels in the figure are:

1-multivariate sensing device, 2-server, 3-monitored object, 11-signal processing center, 12-sensor module, 13-communication unit, 14-sensor group, 101-power supply, 102-central processing unit, 103-memory module, 104-nine axis sensor, 105-analog and digital video camera, 1051-first analog and digital video camera, 1052-second analog and digital video camera, 106-multispectral camera, 107-thermal imaging camera, 108-structured light sensor, 109-radar, 110-ultrasonic transmitter, 1101-first ultrasonic transmitter, 1102-second ultrasonic transmitter, 111-ultrasonic receiver, 1111-first ultrasonic receiver, 1112-second ultrasonic receiver, 1111-ultrasonic receiver, etc, 112-auxiliary lighting component, 113-communication module, 1131-optical communication module, 1132-wireless communication module, 114-I/O interface, 115-backplane, 116-ceiling, 117-side wall, 118-motherboard, 120-fiber assembly, 121-first fiber, 122-second fiber, 123-power line, 124-first type via, 125-second type via, 126-third type via, 127-fourth type via, 128-flexible circuit board.

Detailed Description

Hereinafter, the multivariate perception device, system and method of the present invention will be described in detail in connection with exemplary embodiments. In the drawings, like elements are denoted by like reference numerals.

Detailed illustrative embodiments are disclosed in the present invention. However, specific structural and functional details disclosed herein are merely representative for purposes of describing example embodiments. This invention may, however, be embodied in many alternate forms and should not be construed as limited to only the embodiments set forth herein.

Accordingly, while example embodiments are capable of various modifications and alternative forms, these embodiments are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that there is no intent to limit example embodiments to the particular forms disclosed. Rather, the example embodiments are to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure. Like reference numerals refer to like elements throughout the description of the figures.

In the description of the present application, it is to be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience in describing the present application and simplifying the description, but do not indicate or imply that the referred device or element must have a particular orientation, be constructed in a particular orientation, and be operated, and thus should not be construed as limiting the present application.

Although the terms "first," "second," etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present disclosure. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

In the description of the present application, it is to be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "coupled" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.

The terminology used in the description herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. In the description of the present invention, "a plurality" means two or more unless otherwise specified.

It should also be noted that in some alternative implementations, the functions/acts noted may occur out of the order noted in the figures. For example, two figures shown in succession may, in fact, be executed substantially concurrently, or the figures may sometimes be executed in the reverse order, depending upon the functionality/acts involved.

In the following description, specific details are provided to provide a thorough understanding of example embodiments. However, it will be understood by those of ordinary skill in the art that the example embodiments may be practiced without these specific details. For example, systems may be shown in block diagrams in order not to obscure the example embodiments in unnecessary detail. In other instances, well-known processes, structures and techniques may be shown without unnecessary detail in order to avoid obscuring example embodiments.

In the following description, illustrative embodiments will be described with respect to acts, and symbolic representations of operations (e.g., in the form of flowcharts, flow diagrams, data flow diagrams, structure diagrams, block diagrams, etc.) that can be implemented as program modules or functional processes include subroutines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types and that can be implemented using existing hardware in existing network elements. Such existing hardware may include one or more Central Processing Units (CPUs), Digital Signal Processors (DSPs), application specific integrated circuits, programmable gate arrays (FPGAs), computers, and the like.

Although a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel, concurrently, or simultaneously. Additionally, the order of the operations may be rearranged. A process may terminate when its operations are completed, but may have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, etc. When a process corresponds to a function, its termination may correspond to a return of the function to the calling function or the main function.

Fig. 1 shows a schematic diagram of a multivariate perception device in an exemplary embodiment of the invention.

In a first exemplary embodiment of the invention, as shown in fig. 1, the multivariate sensing device 1 comprises a central processing unit 102, and a sensor module 12 and a communication unit 13 connected to and controlled by said central processing unit 102. The multi-element sensing device 1 can also participate in local processing of the data acquired by the sensor.

The sensor module 12 is used for sensing status information of the monitored object and generating sensing data. The monitored object may include a monitored device, an object, or the like, and may include, for example, an industrial device, an industrial product, an agricultural product, a specific environment, or the like, such as a wind power generator, a hydroelectric generator, a thermal power generator, a mining and transportation device, or the like, a crop in a farm, a specific environment, such as a grassland, a pasture, or the like, such as the multivariate sensing device itself. The perception data includes at least one of a sound field signal, a location field signal, and an electromagnetic field signal. Namely, acoustic field signals, light field signals, electric field signals, force field signals, and position field signals, and combinations of any two or three thereof.

The measurement range of the acoustic, optical, electrical, and force field signals includes, but is not limited to, the range that can be sensed by a human or other living being. For example, a sound field represents a signal propagated by vibration of a substance, including a sound signal that is not perceivable by a human being; by analogy, the light field signal includes visible light and non-visible light; electric field signals, that is to say electromagnetic field signals, electromagnetic field signals also including electromagnetic field signals which are measurable today and temporarily unmeasurable; force fields include measurable and unmeasurable forces, both intrinsic and extrinsic, that produce acceleration and displacement, and that produce gravitational forces and masses.

In particular, the sound field signal may include the frequency, loudness of sound, and spatial coordinates of the sound source, which may be collected by one or more of a microphone, an ultrasonic receiver, and an ultrasonic receiver.

The location field signal may include: the displacement, speed, acceleration and current position state of the monitored equipment during the operation process of multi-element sensing acquisition, and the position field signal can be acquired by any one or more of one-axis or multi-axis (typically one-axis, three-axis or nine-axis) sensor, gyroscope, gravity accelerometer, magnetometer, optical wave and electromagnetic wave position measurement, and speed and acceleration device.

The light field signals include images taken by a video camera, video, ambient light, the video camera may include one or more of analog and digital video cameras, thermal imaging cameras, multispectral cameras, hyperspectral cameras, structured light sensors, and radar in different bands. Wherein, the analog and digital camera can be used for shooting the image and/or video of the monitored object to monitor one or more of the vibration, displacement and current state deformation information of the monitored object; the thermal imaging camera can be used for shooting thermal infrared radiation of the monitored object so as to monitor the running state, the energy distribution and the running environment of the monitored object as well as the temperature, the humidity and the material composition of the monitored object; the multispectral camera can be used for monitoring the keeping and flowing states of liquid, gas and various component substances of the monitored object, so as to monitor the phenomena of air leakage, oil leakage, liquid leakage, oil shortage and liquid shortage of specific substances (or objects), such as one or more of plant stem and leaf states and soil evaporation and infiltration information; the structured light sensor can be used for monitoring a 3D image and the size of the image, and/or used for monitoring a video of a monitored object, monitoring the displacement, distortion and rotation states of the monitored object, and monitoring thermal expansion and cold contraction data of the monitored object; radar can be used for radar imaging to monitor the condition (normal and abnormal conditions) of the object and object being monitored, the tendency of cracks or defects to occur, the location and current condition or damage level.

The communication unit 13 is used to perform communication with an external device. The external device may be one or more of a server, a cloud database, and other multi-sensing devices.

The sensing data can be transmitted to the server by the communication unit 13 for processing so as to judge whether the monitored object is in a normal operation process and state; the sensing data may also be processed in the central processing unit 102 to determine whether the monitored object is in a normal operation process and state, and meanwhile, the central processing unit 102 may also transmit a signal containing the determination result to the server or the cloud database through the communication unit 13.

According to the multi-element sensing device provided by the embodiment of the invention, the sound, light, electricity and force field signals comprise one or more combinations of sound, light, electricity and force field signals, one or more dimensional signals acquired by one or more detected objects and operation processes and states thereof are processed, and results and data are transmitted to a server and/or a cloud database.

Another feature of the multivariate sensing device is that a specific sensor can be configured with one or an array to complete subsequent data processing tasks that can only be completed by array signals. Such as a single sound sensor, can capture the frequency, amplitude of the sound. But an array of sound sensors can, in addition to establishing a specific sound propagation coverage effect, also determine the spatial coordinates of a specific sound source. The multivariate perception array will be described in detail in the multivariate perception system hereinafter.

According to the multi-element sensing device provided by the embodiment of the invention, on one hand, information of multi-element signals can be provided for the sensing device to help the problem discovery and positioning, on the other hand, a sensor module for sensing various signals is integrated in one device, so that various signals can be monitored, and the situation that one device of the traditional industrial monitoring device only monitors one type of signals is broken through.

According to the multi-element sensing device provided by the embodiment of the invention, because the multi-element sensor is integrated, the sound, light and electricity sensing can detect vibration, displacement and deformation; temperature and its distribution; audio and ultrasonic signals, electromagnetic signals, optical signals, and visual and super-visual signals.

Fig. 2 shows a schematic structural diagram of a multivariate sensing device in an exemplary embodiment of the invention. Fig. 3 shows an exploded schematic view of fig. 2.

In a second exemplary embodiment of the present invention, as shown in fig. 2 and 3, the multivariate sensing device may include a main board 118, and a signal processing center 11 and a sensor module 12 disposed on the main board 118.

The information that can be sensed by the sensor module 12 includes: changes in images, video, sound fields, electromagnetic fields, vibrational displacement deformation fields, temperature, humidity, etc.

The sensor module 12 may comprise a sensor group, i.e. a plurality of sensors. Specifically, the sensor module may include a nine-axis sensor 104, an analog and digital video camera 105 (including a first analog and digital video camera 1051 and a second analog and digital video camera 1052 in fig. 3), a multispectral camera 106, a thermographic camera 107, a structured light sensor 108, a radar 109, an ultrasonic transmitter 110 (including first and second ultrasonic transmitters 1101 and 1102 in fig. 3), and an ultrasonic receiver 111 (including first and second ultrasonic receivers 1111 and 1112 in fig. 3). The data sensed by the sensor group includes data, images, and the like.

The gyroscope, the gravity acceleration electronic compass and the nine-axis sensor are used for sensing vibration, displacement or deformation information of the position of the monitored object and sensing temperature and humidity information of the position of the monitored object.

An analog and digital camera 105 for capturing high definition images and video of the monitored object to monitor one or more of vibration, displacement and deformation information of the monitored object.

The multispectral camera 106 is used for monitoring the keeping and flowing states of liquid and gas in the monitored object, so that the multispectral camera can be used for monitoring the phenomena of air leakage, oil leakage, liquid leakage, oil shortage, liquid shortage and the like of the monitored object, and can be used for monitoring the states of plant stems and leaves, soil evaporation and infiltration and the like.

The thermal imaging camera 107 is used for shooting thermal infrared radiation of the monitored object in the operation process, air circulation of the operation environment, the temperature, air humidity and components of the operation environment and the monitored object.

The structured light sensor 108 is used for monitoring 3D data of the monitored object, including D images and/or video, monitoring the state of displacement, distortion, rotation of the monitored object, and monitoring thermal expansion and cold contraction data of the monitored object.

The radar 109, through radar imaging, may be used for active flaw detection of the object, and for the state of the object, including normal and abnormal states, operation fatigue state, or local damage state, the occurrence tendency, position, and current state of a crack or defect.

The ultrasonic transmitter 110 and the ultrasonic receiver 111 need two sensors to work together, and the physical coordinates of the monitored equipment are accurately positioned through ultrasonic waves, so that the coordinate information is calibrated. In the present exemplary embodiment, by providing two sets of ultrasonic transmitters and ultrasonic receivers with different orientations, the first ultrasonic transmitter 1101 and the first ultrasonic receiver 1111 have the same orientation, and the second ultrasonic transmitter 1102 and the second ultrasonic receiver 1112 have the same orientation, so that the multivariate perception device 1 can transmit ultrasonic waves in different directions and can receive ultrasonic waves in different directions, and can more accurately locate the physical coordinates of the monitored equipment and calibrate the coordinate information.

The sensors can work independently or simultaneously after being combined randomly.

The signal processing center may include a power supply 101, a central processing unit 102, a memory module 103, a communication unit 13, and an auxiliary lighting component 112.

The auxiliary lighting component 112 can emit light in a predetermined wavelength band and/or predetermined encoded light to assist in imaging or fill-in of one or more of the analog and digital video camera 105, the multi-spectral camera 106, the hyper-spectral camera, the thermal imaging camera 107, and the structured light sensor 108. That is, the auxiliary lighting unit 112 is used in cooperation with the analog and digital video camera 105, the multispectral camera 106, the hyperspectral camera, the thermal imaging camera 107, and the structured light sensor 108 to supplement light or actively emit light of a spectrum of one wavelength band, thereby assisting imaging.

The storage module 103 is used for storing sensing data and/or data generated by the central processing unit 102. That is, the storage module 103 may be used to store the sensing data collected by the sensor group. The memory module 103 can also be used for other data generated by the central processing unit 102. The storage module 103 may be a Memory with a read-write function, such as a NAND Flash Memory, a Memory card, or a mini-SD/T-Flash/RS-MMC.

The power supply 101 is used for supplying energy required for the operation of the central processing unit 102, the communication unit 13, and the sensor module 12 (or referred to as a sensor group). The power source 101 may be an external power source, such as commercial power, an external battery, etc.; it may also be a built-in battery, such as a lithium battery or the like; an external power supply and a built-in battery can also be included. The external power supply port can adopt any one of a DC-Jack mechanical structural part or a USB, a Micro USB and a USB Type C mechanical structural part. The built-in battery provides electric energy when the external power supply can not normally supply power. That is, the built-in battery is responsible for providing uninterrupted power supply when the device is not connected with an external power line or power is cut off during use.

The central processing unit 102 is used for processing data from the sensor group, first collecting status information of the monitored equipment, storing the collected status information in the local storage module 103, and transmitting the collected status information to the server 2 through the communication unit 13 (described in detail later), and analyzing and processing the status information by the server 2.

However, the present invention is not limited to this, and the multivariate perception device 1 according to the embodiment of the present invention may have a function of data processing, in addition to collecting data to the server 2 for analysis and processing. According to the embodiment of the invention, the data can be sent to the cloud database and analyzed and processed by the cloud database.

Specifically, the central processing unit 102 may also compare the collected status information with data of a local database, determine whether the monitored equipment is in a normal state, and transmit a signal containing the determination result to the server 2 through the communication unit 13. The signal containing the judgment result can comprise data and information of the monitored equipment in a normal or abnormal operation state, and one or more of position information, time information, a sound field signal of the environment where the monitored equipment is located, a light field signal, an electric field signal, a force field signal and a position field.

For example, when the monitored device is in an abnormal state, an alarm signal may be sent to the server 2 through the communication unit 13. The alarm signal includes but is not limited to abnormal state information of the monitored equipment, position information, time information, weather information of the location of the monitored equipment, temperature and humidity information and the like.

The central processing unit 102 may be one or more CPUs, MCUs, FPGAs, DSPs, etc. having control or digital processing functions. For example, the central processing unit 102 may be one or more MTK8878 microprocessors.

The communication unit 13 may include a communication module 113 and an I/O interface 114.

The communication module 113 (including the optical communication module 1131 and the wireless communication module 1132) is responsible for transmitting the sensing data and the local operation data collected by the signal processing center to other devices or servers in a wired or wireless manner, where the wireless system includes, but is not limited to, NFC (near field communication), BT (bluetooth), WIFI (wireless network communication), mobile network technologies such as 2G/3G/4G/5G/LTE, FM (modulation communication), and the like. Wired systems include, but are not limited to, fiber optic or other communications.

That is, the communication module 113 can transmit the sensing data in a wired (e.g., network cable, optical fiber, cable, etc.) or wireless (e.g., WIFI, BT, NFC, ZigBee, 2G, 3G, 4G, 5G, LTE, FM, etc.) manner.

According to the embodiment of the invention, the multi-element sensing device can support data extraction in two states of connection with the Internet and disconnection from the Internet. Under the condition of no networking, the multi-element sensing device can realize data exchange in modes of NFC (near field communication), BT (Bluetooth), infrared, WIFI (wireless network communication) and the like. In the networking state, the data exchange is realized by mobile networks such as 2G/3G/4G/5G/LTE and the like or other modes of connecting the Internet. The communication module 113 may include an optical communication module 1131. The optical communication module 1131 may be a fiber optic data transmission module. More specifically, the optical communication module 1131 may be a two-in two-out optical fiber data transmission module, and may further have a broadband data transmission function. The multivariate sensing device 1 can also include a fiber optic assembly 120 coupled to the optical communication module 1131.

As shown in fig. 2 and 3, in this embodiment, the fiber optic assembly 120 may be a two-in two-out fiber. In particular, the fiber optic assembly 120 may include a first optical fiber 121 and a second optical fiber 122, the first optical fiber 121 being capable of functioning as an input or output optical fiber, and the second optical fiber 122 being capable of functioning as an input or output optical fiber. That is, data may be transmitted through the first optical fiber 121, may be transmitted through the second optical fiber 122, and may be simultaneously transmitted through the first optical fiber 121 and the second optical fiber 122. Here, "data transfer" may include data output and/or input. The first optical fiber 121 and the second optical fiber 122 may be single-core optical fibers or multi-core optical fibers.

The two-in two-out optical fiber data transmission module not only solves the problems of broadband data transmission and strong anti-interference, but also solves the networking problem of the sensor array, namely a star network or a ring network; no matter the network is a straight-line network or a tree network, the simple and quick networking without network accessories can be greatly reduced.

The I/O interface 114 includes any one or more of an I/O interface of a mobile network, an I/O interface of an optical communication network, and an I/O interface of other modes, which are configured with the communication module, so as to receive data, transmit data, forward a data packet of a network layer, and the like. The data packet forwarding can support protocols such as TCP/IP, IPX/SPX, AppleTalk and the like.

As shown in fig. 3, the sensor module 12 includes a first analog and digital video camera 1051, a second analog and digital video camera 1052, a multispectral camera 106, a thermography camera 107, a structured light sensor 108, a radar 109, a first ultrasonic transmitter 1101, a second ultrasonic transmitter 1102, a first ultrasonic receiver 1111, and a second ultrasonic receiver 1112.

The thermal imaging camera 107, multispectral camera 106, and structured light sensor 108 are all co-planar (i.e., the sensing area is at the same level) with the analog and digital video camera 105. Meanwhile, there is partial overlap of the thermal imaging camera 107, the multispectral camera 106, and the structured light sensor 108 with the region that the first analog and digital video camera 1051 can perceive. For example, the structured light sensor 108 is positioned below the first analog and digital video camera 1051, the multispectral camera 106 is positioned to the left of the first analog and digital video camera 1051, and the thermal imaging camera 107 is positioned to the right of the first analog and digital video camera 1051. Meanwhile, a second analog and digital video camera 1052 may also be disposed below the multispectral camera 106 (i.e., to the left of the structured-light sensor 108). Such that there is a partial overlap of the regions that the multispectral camera 106 and the structured-light sensor 108 are able to perceive.

The radar 109 may be positioned to the left of the ultrasonic transmitter, for example to the left of the second ultrasonic transmitter 1102.

The second ultrasonic receiver 1112 may be disposed below the second ultrasonic transmitter 1102 so as to receive a return of the ultrasonic wave emitted from the second ultrasonic transmitter 1102 or other ultrasonic waves.

Similarly, the first ultrasonic receiver 1111 may be disposed above or below the first ultrasonic transmitter 1101 so as to receive the ultrasonic waves.

The signal processing center 11 may include a power supply 101, a central processing unit 102, a storage module 103, a communication module 113, and an I/O interface 114.

The power supply 101 is electrically connected to the central processing unit 102, the memory module 103, and the sensor module 12 to supply power. The power supply 101 may be located to the left of the signal processing center. The power source 101 may be a permanent or removable battery, a fuel cell or photovoltaic voltage cell, or the like. The power supply 101 may be disposable. The power supply 101 may also be powered or charged by an AC/DC power source. In one embodiment, the power source 101 may comprise, for example, a rechargeable lithium ion battery, or a similar battery may be used.

The central processing unit 102 is electrically connected to the memory module 103, the communication unit 13, and the sensor module 12, and the electrical connection method may be an electrical connection method capable of data transmission, such as a copper wire or a flexible circuit board.

The communication module includes an optical communication module, which may be a separate motherboard assembly and connected to the signal processing center via a flexible circuit board 128.

Although fig. 3 shows a manner in which the respective sensors and the components of the signal processing center are arranged on the main board 118, the present invention is not limited to this, the arrangement of the respective sensors and the components of the signal processing center can be adjusted as needed, and in addition, the signal processing center and the sensor group in this embodiment can be integrated into a main board or separated on a plurality of main board components. The main board 118 may be a PCB or PCBA board, and the plurality of main board components may also be PCB or PCBA boards, etc., and the main board components may be combined to form a main board by soldering, using a flexible circuit board for connection, or other electrical connection means.

As shown in fig. 2 and 3, the multivariate sensing device 1 can further comprise a housing. The housing may include a top plate 116, a bottom plate 115, and sidewalls 117, among others. The top plate 116, the bottom plate 115, and the side walls 117 form a cubic receiving space.

The sidewalls are vertically formed at all four sides of the bottom plate at a predetermined height, thereby setting an outer periphery of the cubic space. The first type of via 124 and the second type of via 125 are formed on the sidewalls. The first type of through-hole 124 is used for mounting a multi-element sensing device. For example, the multi-element sensing device 1 is fixed by bolts through the first type of through holes 124. The second type of through holes 125 are used for connecting the inside of the multi-element sensing device with the outside, for example, for passing a power line 123 and for passing an optical fiber.

The side wall can also be provided with equally spaced anti-slip grooves.

A third type of through hole 126 is formed in the top plate for the sensor module to sense the monitored equipment. For example, a third type of through hole is formed at the top plate corresponding to the sensors of the analog and digital video camera 105, the multispectral camera 106, the thermal imaging camera 107, the structured light sensor 108, the radar 109, and the second ultrasonic transmitter 1102, so as to prevent the top plate from affecting the imaging of the thermal imaging camera 107.

A fourth type through hole 127 may be further formed on the top plate to transmit light of a specific wavelength band emitted from the auxiliary lighting member.

When the top plate is combined on the side wall, the edge of the top plate is tightly attached to the inner surface of the side wall.

The assembled main board, the sensor module, the signal processing center and the like are accommodated in the shell. The power supply wires, optical fiber wires, extend from the second type through holes 125 so as to be exposed to the outside of the housing. The sensing part of the sensor module is exposed through the third type through-hole 126.

Although the rectangular housing is described by way of example, the present invention is not limited thereto, and may be formed, for example, as a pocket housing, as long as it can accommodate the assembled main board, sensor module, and signal processing center.

FIG. 4 shows a schematic diagram of a multivariate perception system according to an exemplary embodiment of the invention. FIG. 5 shows a schematic diagram of a multivariate perception system according to an exemplary embodiment of the invention.

In a third exemplary embodiment of the present invention, as shown in fig. 4 and 5, the multivariate perception system comprises a server 2 and the multivariate perception device 1 as described above.

The server 2 can communicate with the multivariate sensing device 1 and is configured to process the sensing data to determine whether the monitored equipment is in a normal operation state and send the determination result to the user.

The server 2 may include a fixed device and/or a mobile device with built-in application programs for communicating and data processing with the multi-sensing apparatus 1, for example, a computer device, a wearable device with built-in application programs, a smart phone, an ipad and other smart terminal devices.

The multivariate perception system may comprise at least two multivariate perception devices 1 connected. The server 2 communicates with any one or more of the at least two multivariate sensing devices 1.

The plurality of multivariate sensing devices 1 form a multivariate array sensing device. For example, for positioning of acoustic targets, a plurality of multivariate sensing devices in an array are adopted to detect the same acoustic signal, and because the transmission paths and the transmission time are different, the positioning estimation is completed. In the array type intelligent perception processing system, each independent device can complete the data collection and data processing, and the background can also process big data.

When the number of the multi-element sensing devices is at least two, networking can be formed between the at least two multi-element sensing devices through an optical bus (such as an optical fiber), or networking can be formed between the at least two multi-element sensing devices and a wireless network through the optical bus. For example, a star-shaped network, a ring network, a straight-line network or a tree network is formed. In an embodiment, at least two multivariate sensing devices are connected with the server 2 after forming a network, for example, as shown in fig. 5, 6 multivariate sensing devices are connected with the server 2 after forming a linear network.

According to the embodiment of the disclosure, the problems of data acquisition of a multi-element multi-bit array, real-time data transmission, bidirectional monitoring and control of sensing equipment of the internet of things and industrial industry application systems can be comprehensively solved through the two-in and two-out optical fiber data transmission modules, and the wide application requirements of the current industrial internet of things industry can be responded with higher efficiency, convenience and systematicness.

The monitored equipment may be one or more. That is, one object may be monitored by one multivariate sensing device, a plurality of objects may be monitored by one multivariate sensing device, one object may be monitored by a plurality of multivariate sensing devices, and a plurality of objects may be monitored by a plurality of multivariate sensing devices.

In a fourth exemplary embodiment of the present invention, a multivariate perception method of the present disclosure will be described with reference to the accompanying drawings.

The perception method comprises the following steps: sensing state information of a monitored object and generating sensing data, wherein the sensing data comprises at least one of sound field signals, light field signals, electric field signals, force field signals and position field signals; processing the sensing data and judging whether the monitored object is in a normal operation state; when the monitored object is in a normal operation state, sending state data and signals of the monitored object; and transmitting the state data and the alarm signal of the monitored object when the monitored object is in the abnormal operation state.

As shown in fig. 4, six multivariate sensing devices 1 form a linear network and then are connected to a server 2, and monitoring of an object can be achieved through the following steps. In the following, the object is described as a device, but the present invention is not limited to this, and the object may be another object or the like.

S1, the multi-element sensing device 1 senses the state information of the monitored equipment and generates sensing data, and the sensing data is stored in the storage module or is transmitted to the background server through the communication module or the I/O interface.

The sensing data is acquired by a sensor module of the multi-element sensing device, and the sensing data can be information recording the running state of monitored industrial equipment, the growth state of crops or the working state of the multi-element sensing device, such as images and videos of the industrial equipment, a sound field, an electromagnetic field, a vibration displacement deformation field, temperature and humidity and the like when the industrial equipment runs.

S2, analyzing the sensing data to obtain the state of the monitored equipment, comparing the state with the local information, and judging whether the monitored equipment is in a normal state; or analyzing the sensing data to obtain the state of the monitored equipment, and sending the state to the server; or send the perception data to a server.

The local information is stored in a storage module. In the monitoring system based on the multi-element sensing devices, each multi-element sensing device can analyze the acquired sensing data to obtain the state of the monitored equipment, and the state can be compared with local information.

Step S2 may further include the server receiving the sensing data, analyzing the status of the monitored device according to the received sensing data, and comparing the status with the historical information to determine whether the monitored device is in a normal status.

Or the server receives the state of the monitored equipment and compares the state with the historical information to judge whether the monitored equipment is in a normal state.

The historical information is the state of the monitored equipment analyzed by the sensing data received by the server before receiving the current sensing data, or the state of the monitored equipment received by the server before receiving the state of the monitored equipment.

The state of the server compared with the historical information can be transmitted by the same multi-element sensing device within a preset time, or can be transmitted by a plurality of multi-element sensing devices.

And S3, when the monitored equipment is in an abnormal state, sending an alarm signal to the server. The alarm signal can comprise abnormal state information of the equipment, position information, time information, weather information and temperature and humidity information of the location of the equipment and the like. When the monitored equipment is crops, the alarm signal can comprise information of the conditions of water shortage, fertilizer shortage, plant diseases and insect pests and the like of the crops. When any one multi-element sensing device in the monitoring system based on the multi-element sensing devices judges that the monitoring equipment is in an abnormal state, an alarm signal is sent to the server. For example, when the multi-element sensing device monitors that the operating temperature of the industrial equipment is not in a normal range, the temperature suddenly changes and the like, an alarm signal is sent to the server.

In summary, the beneficial effects of the invention can include:

(1) the multi-element sensing device integrates a plurality of sensors, and reduces the cost and difficulty of system integration and operation and maintenance.

(2) The intelligent control system has a small appearance, can be suitable for various scenes by configuring different software, can be repeatedly utilized, and saves cost.

(3) Meanwhile, the sensing capability of the sensor on four signals of sound, light, electricity and force can monitor various signals, and the technical problems of detection and data acquisition of various signals can be efficiently solved.

(4) The system is provided with the optical fiber data transmission module, and can efficiently, conveniently and systematically respond to wide requirements of the application of the current industrial Internet of things industry.

Although the present invention has been described above in connection with the exemplary embodiments and the accompanying drawings, it will be apparent to those of ordinary skill in the art that various modifications may be made to the above-described embodiments without departing from the spirit and scope of the claims.

Claims (13)

1. A multi-element sensing device is characterized in that the multi-element sensing device comprises a central processing unit, a sensor module and a communication unit which are connected with the central processing unit and controlled by the central processing unit,

the sensor module is used for sensing state information of a monitored object and generating sensing data, wherein the sensing data comprises at least one of sound field signals, light field signals, electric field signals, force field signals and position field signals;

the communication unit is used for executing communication with an external device;

the sensing data is transmitted to a server or a cloud database by the communication unit for processing so as to judge whether the monitored object is in a normal operation process and state; and/or the sensing data is processed in the central processing unit to judge whether the monitored object is in a normal operation process and state, and signals containing the judgment result are transmitted to a server and/or a cloud database through the communication unit.

2. The multivariate sensing device according to claim 1, wherein the sound field signals represent signals of vibratory propagation of a substance;

the electric field signal refers to an electromagnetic field signal;

the force field signals include measurable and unmeasurable forces, both intrinsic and extrinsic, that produce acceleration and displacement, resulting in gravitational forces and masses; the position field signal includes: the displacement, the speed, the acceleration and the current position state of the monitored object in the running process are acquired by the multi-element sensing device, and the position field signals are acquired by any one or more of an one-axis or multi-axis sensor, a gyroscope, a gravity accelerometer, a magnetometer and a device for measuring the position, the speed and the acceleration by light waves and electromagnetic waves;

the light field signals include images, video, ambient light captured by a video camera, including one or more of analog and digital video cameras, thermal imaging cameras, multi-spectral cameras, hyper-spectral cameras, structured light sensors, and radar in different bands, wherein,

the analog and digital cameras are used for shooting images and/or videos of the monitored object so as to monitor one or more of vibration, displacement, deformation and current state information of the monitored object;

the thermal imaging camera is used for shooting thermal infrared radiation of the monitored object so as to monitor the running state, the energy distribution and the running environment of the monitored object as well as the temperature, the humidity and the material composition of the monitored object;

the multispectral camera is used for monitoring the keeping and flowing states of liquid, gas and various component substances in the monitored object, so that the phenomena of air leakage, oil leakage, liquid leakage, oil shortage and liquid shortage of specific substances or objects are monitored;

the structured light sensor is used for monitoring 3D images and/or videos of the monitored object, monitoring the displacement, distortion and rotation states of the monitored object, and monitoring thermal expansion and cold contraction data of the monitored object;

the radar is used for radar imaging to monitor the state, normal and abnormal states, the occurrence trend of cracks or defects, the position and the current state or damage degree of the monitored object.

3. The multivariate perception device according to claim 2, further comprising an auxiliary lighting device capable of emitting light of a predetermined wavelength band or/and a predetermined code to assist in imaging or supplementing one or more of the analog and digital video camera, multispectral camera, hyperspectral camera, thermal imaging camera and structured light sensor.

4. The multi-element sensing device according to claim 1, wherein the signal containing the determination result includes data and information that the object is in a normal or abnormal operating state, and one or more of position information, time information, a sound field signal, a light field signal, an electric field signal, a force field signal, and position field information of an environment in which the object is located.

5. The multi-sensor apparatus according to claim 1, wherein the external device comprises one or more of the server, a cloud database, and/or other multi-sensor apparatus.

6. The multivariate sensing device of claim 1, further comprising a memory coupled to the sensor module and the central processing unit to store the sensed data and data generated by the central processing unit.

7. The multivariate perception device according to claim 1, wherein the communication unit comprises a communication module and an I/O interface.

8. The multi-element sensing device of claim 7, wherein the communication module comprises an optical communication module, and further comprising a fiber optic assembly coupled to the optical communication module.

9. The multivariate sensing device according to claim 8, wherein the optical fiber assembly comprises a first optical fiber and a second optical fiber, the first optical fiber can be used as an input or/and output optical fiber, and the second optical fiber can be used as an input and/or output optical fiber to complete an optical communication network and automatically compose a self-healing ring data communication network.

10. A multivariate perception system, comprising: a multivariate sensing device as defined in any one of claims 1-9; and the server and/or the cloud database can be communicated with the multi-element sensing device and is configured to process the sensing data to judge whether the monitored object is in a normal operation state.

11. The multivariate perception system according to claim 10, wherein the multivariate perception system comprises a plurality of the multivariate perception devices connected, and the server and/or cloud database is in communication with each connected multivariate perception device.

12. The multi-element sensing system according to claim 11, wherein adjacent multi-element sensing devices are connected by optical fibers to form a network, and the multi-element sensing devices and the server communicate with each other through an optical fiber network.

13. A multivariate perception method using the multivariate perception system according to any one of claims 10-12, comprising the steps of:

sensing state information of a monitored object and generating sensing data, wherein the sensing data is at least one of sound field signals, light field signals, electric field signals, force field signals and position field signals;

processing the sensing data and judging whether the monitored object is in a normal operation state;

when the monitored object is in a normal operation state, sending state data and signals of the monitored object;

and transmitting the state data and the alarm signal of the monitored object when the monitored object is in an abnormal operation state.

Images