JP2023149905A - Server, processing method, and program - Google Patents

Abstract

To provide a technique that allows for further improving convenience of users trying to recognize a detection target.SOLUTION: A server is provided, comprising a control unit configured to provide control to analyze intensity of sensor data for each sensor data frequency and sensor data acquisition time using the sensor data received from the sensor, obtain an analysis result, and provide a terminal with the analysis result.SELECTED DRAWING: Figure 1

Description

The present invention relates to a server, a processing method, and a program.

In recent years, techniques for detecting objects to be detected using sensors have been known. For example, a technique is known that extracts frequency components belonging to each of a plurality of frequency categories from frequency components constituting an acoustic signal detected by a plurality of microphones (see, for example, Patent Document 1). In this technique, extracted frequency components are displayed in different display colors for each frequency segment. According to this technology, a user can intuitively recognize that a specific detection target has been detected.

Japanese Patent Application Publication No. 2014-85386

However, it is desired to provide a technology that can further improve convenience for users who are trying to recognize objects to be detected.

In order to solve the above problem, according to one aspect of the present invention, based on sensor data received from a sensor, the intensity of the sensor data is analyzed for each frequency of the sensor data and the time at which the sensor data is obtained. A server is provided, which includes a control unit configured to obtain an analysis result and provide the analysis result to a terminal.

The control unit determines whether the intensity of the sensor data is greater than a first threshold value for each frequency and time based on the sensor data, and determines the result obtained by the determination as the analysis result. You may get it.

The control unit detects, based on the sensor data, a first frequency band in which the intensity of the sensor data is greater than the first threshold, and the first frequency band is wider than the first band. Based on this, the first detection target may be detected.

The control unit detects, based on the sensor data, a first time at which there is a frequency where the intensity of the sensor data is greater than the first threshold, and detects a second time after a predetermined time from the first time. A frequency band in which the intensity of sensor data at the time of is greater than the first threshold value may be detected as the first frequency band.

The control unit may control the terminal to provide identification information corresponding to information related to detection based on the detection of the first detection target.

The first detection target may be a ship.

The control unit may detect the second detection target based on a model generated in advance by machine learning and the analysis result.

The control unit detects the second detection target based on the fact that a detection probability of the second detection target output based on the model and the analysis result is greater than a predetermined probability. It's okay.

The control unit may control to provide identification information corresponding to information related to detection to the terminal based on the detection of the second detection target.

The second detection target may be a diver.

The control unit detects a second frequency band in which the intensity of the sensor data is higher than a second threshold based on the sensor data, and detects a second frequency band based on the fact that the second frequency band is wider than the second band. Then, the detection of the second detection target may be canceled.

The control unit detects a time when the intensity of the sensor data is greater than a second threshold based on the sensor data, and detects the second detection target based on the time being shorter than a predetermined time. Detection may be canceled.

The control unit may perform control to provide information related to the detection to the terminal based on receiving a transmission request based on the identification information from the terminal that has received the identification information.

The information related to the detection may include a map according to the position of the sensor.

The control unit may control to provide the analysis result to the terminal based on receiving a request to send the analysis result from the terminal.

The control unit transmits the analysis result and at least one of air pressure, water temperature, and wind power to the terminal, based on receiving a request to send the analysis result from the terminal. It may be controlled so that it is given to

The sensor may be an acoustic sensor, and the sensor data may be sound obtained by the acoustic sensor.

The sensor data may be detected by a sensor section included in the sensor, and the sensor section may exist underwater.

According to another aspect of the present invention, based on the sensor data received from the sensor, the intensity of the sensor data is analyzed for each frequency of the sensor data and the time at which the sensor data is obtained to obtain an analysis result. A processing method is provided, which includes controlling to provide the analysis result to a terminal.

According to another aspect of the present invention, based on the sensor data received from the sensor, the computer analyzes the intensity of the sensor data for each frequency of the sensor data and the time at which the sensor data is obtained. A program is provided for obtaining results and controlling the analysis results to be provided to the terminal.

As described above, according to the present invention, it is possible to further improve convenience for a user who wants to recognize a detection target object.

1 is a diagram showing a configuration example of an anti-poaching IoT system according to an embodiment of the present invention. It is a figure showing an example of composition of an underwater acoustic sensor. FIG. 2 is a diagram showing an example of a functional configuration of a server according to an embodiment of the present invention. It is a figure showing an example of sensor information. FIG. 3 is a diagram illustrating an example of notification destination information. FIG. 2 is a diagram showing an example of a functional configuration of a supervisor terminal according to an embodiment of the present invention. FIG. 3 is a diagram showing a first example of a spectrogram obtained by analysis by an analysis unit. FIG. 7 is a diagram illustrating a second example of a spectrogram obtained by analysis by an analysis unit. FIG. 3 is a diagram showing an example of a sound pattern obtained by analysis by an analysis unit. It is a figure showing an example of a detection email. It is a figure which shows the example of a detection screen when a detection target object is detected by one underwater acoustic sensor. FIG. 3 is a diagram showing an example of a spectrogram displayed by a supervisor terminal. FIG. 3 is a diagram showing an example of a sound pattern displayed by a supervisor terminal. FIG. 7 is a diagram illustrating an example when a selection operation of a display switching object is input. FIG. 7 is a diagram illustrating an example when the additional information display area is scrolled. FIG. 7 is a diagram illustrating an example when a selection operation of an additional information display switching button is input. 2 is a flowchart illustrating an example of the operation of the anti-poaching IoT system according to the embodiment of the present invention. 1 is a diagram showing a hardware configuration of an information processing device as an example of a server according to an embodiment of the present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Note that, in this specification and the drawings, components having substantially the same functional configurations are designated by the same reference numerals and redundant explanation will be omitted.

Further, in this specification and the drawings, a plurality of components having substantially the same functional configuration may be distinguished by attaching different numbers after the same reference numeral. However, if there is no particular need to distinguish between a plurality of components having substantially the same functional configuration, only the same reference numerals are given. Further, similar components in different embodiments may be distinguished by attaching different alphabets after the same reference numerals. However, when there is no need to particularly distinguish between similar components of different embodiments, only the same reference numerals are given.

[0. overview]
First, an overview of an embodiment of the present invention will be described.

In recent years, techniques for detecting objects to be detected using sensors have been known. For example, a technique is known that extracts frequency components belonging to each of a plurality of frequency categories from frequency components constituting an acoustic signal detected by a plurality of microphones (see, for example, Patent Document 1). In this technique, extracted frequency components are displayed in different display colors for each frequency segment. According to this technology, a user can intuitively recognize that a specific detection target has been detected.

The embodiments of the present invention mainly propose techniques that can further improve convenience for users who want to recognize objects to be detected. More specifically, in the embodiment of the present invention, attention is paid to the fact that the temporal change in the intensity of sensor data for each frequency differs depending on the object to be detected.

More specifically, in an embodiment of the present invention, an analysis result is obtained based on the sensor data by analyzing the intensity of the sensor data for each frequency of the sensor data and the time at which the sensor data was obtained. The analysis results are then sent to the terminal. This allows users to use their terminals to check the analysis results of sensor data intensity analyzed by frequency and time, which is expected to further improve convenience for users.

In the embodiments of the present invention, it is mainly assumed that an acoustic sensor is used as the sensor. That is, the embodiment of the present invention mainly assumes a case where a detection target is detected by detecting the sound emitted by the detection target from sensor data (sound data) obtained by an acoustic sensor. However, the sensor is not limited to an acoustic sensor, and may be a sensor other than an acoustic sensor (for example, an image sensor, radar, laser sensor, ultrasonic sensor, etc.). Even when a sensor other than an acoustic sensor is used as a sensor, the object can be detected by detecting the characteristics of the object from the sensor data, as in the case where an acoustic sensor is used as the sensor. .

Various objects are assumed to be detected. For example, it can be assumed that the detected object is various objects used for poaching. Examples of various objects used in poaching include poaching boats and poachers. This allows poaching to be monitored by the user. The importance of monitoring poaching is clear from the scale of damage caused by poaching in recent years and the difficulty of detecting poaching. For example, the Japan Coast Guard's annual report “Maritime Security Report 2018” (http://www.kaiho.mlit.go.jp/info/books/report2018/html/honpen/2_04_chap3.html) states that “the seas surrounding Japan The rich marine resources of Japan are by no means inexhaustible, and in order to maintain the balance of the ecosystem and prevent the depletion of marine resources, rules have been established such as setting limits on the amount of fishing, fishing methods, areas, and periods. There is no end to illegal fishing by some fishermen who do not comply, and overfishing of marine resources by organized crime groups aiming to secure funds. We will strive to strictly monitor and crack down on poaching crimes, which are becoming more and more malicious and sophisticated.We will also continue to work closely with related organizations and fisheries-related organizations to implement measures tailored to the characteristics of the region. We will promote comprehensive countermeasures against poaching, including prevention measures, and strive to maintain order in the fishing industry." Therefore, by setting poaching vessels or poachers as objects to be detected, the embodiments of the present invention attempt to solve social issues, and the embodiments of the present invention can be more suitably implemented.

Here, poaching is generally understood to mean ``fishing in secret in violation of the law'' (Daijirin), and includes fishing without a license or permission, and various types of fishing that are prohibited or prohibited fishing methods. This can be interpreted as violating the law or infringing on fishing rights. For example, the Kyoto Prefectural Fisheries Office, which is a branch of the Kyoto Prefectural Agriculture, Forestry and Fisheries Department that handles operations related to the fisheries industry, says, ``Poaching is the taking of organisms that are subject to fishing rights without permission.'' (https://www. pref.kyoto.jp/suiji/documents/mitsuryou.pdf).

For example, it is difficult to detect poaching for the following reasons. In other words, poaching is often carried out at night in a dark environment. Therefore, it is difficult to detect poaching vessels and poachers visually by security personnel or by cameras. Furthermore, in bad weather conditions (e.g. snowfall, typhoons, sea fog, swells, high waves, etc.), visibility is poor, so it is best to detect poaching boats and poachers visually or by cameras during daylight hours. Even if it is difficult. In addition, poaching of marine resources that exist on the seabed (e.g., sea cucumbers, sea urchins, turban shells, abalone, oysters, pearls, etc.) is often carried out by poachers diving, so the seabed can be caught visually or with cameras by security guards. It is difficult to monitor poaching of existing resources.

In view of the difficulty in detecting such poaching, it is desirable to use an acoustic sensor as the sensor when a poaching boat or a poacher is the object to be detected. The reason for this is that the accuracy of sensing by the acoustic sensor is hardly affected by the brightness of the environment (time of day) and visibility (weather conditions). Further, if the sensing portion of the acoustic sensor is located underwater, the acoustic sensor can easily detect poachers attempting to take resources existing under the sea. Hereinafter, an acoustic sensor in which the sensing portion is located underwater will also be referred to as an "underwater acoustic sensor."

In the following, it is mainly assumed that the user is a "monitor" who monitors poaching, and the user's terminal is a "monitor terminal" used by the monitor.

The outline of the embodiment of the present invention has been described above.

[1. Details of embodiment]
Next, details of embodiments of the present invention will be described.

[1-1. System configuration]
First, a configuration example of a system according to an embodiment of the present invention will be described. Note that, hereinafter, assuming that the system according to the embodiment of the present invention is used for anti-poaching, the system according to the embodiment of the present invention will also be particularly referred to as an "anti-poaching IoT (Internet of Things) system." However, the system according to the embodiment of the present invention may be used for purposes other than anti-poaching (that is, the system according to the embodiment of the present invention is not limited to an IoT system).

FIG. 1 is a diagram showing a configuration example of an anti-poaching IoT system according to an embodiment of the present invention. As shown in FIG. 1, the anti-poaching IoT system 1 includes underwater acoustic sensors 10-1 to 10-N (N is an integer of 1 or more), a server 20, and supervisor terminals 30-1 to 30-M. (M is an integer of 1 or more). Note that, hereinafter, each of the underwater acoustic sensors 10-1 to 10-N will also be referred to as the "underwater acoustic sensor 10" when there is no need to distinguish between the underwater acoustic sensors 10-1 to 10-N. Similarly, when there is no need to distinguish between the supervisor terminals 30-1 to 30-M, each of the supervisor terminals 30-1 to 30-M is also referred to as a "supervisor terminal 30."

In the embodiment of the present invention, it is mainly assumed that each of the supervisor terminals 30-1 to 30-M is used by a different supervisor. However, multiple supervisor terminals 30 may be used by one supervisor, or one supervisor terminal 30 may be used by multiple supervisors.

In the embodiment of the present invention, it is assumed that the underwater acoustic sensor 10 communicates with a server 20 existing on the Internet via a mobile network such as an LTE (Long Term Evolution) network. However, the underwater acoustic sensor 10 may be able to communicate with the server 20 by other communication means, such as multi-hop wireless communication means.

On the other hand, the server 20 may be realized by a computer having a server function.

Furthermore, in the embodiment of the present invention, it is mainly assumed that the supervisor terminal 30 is configured by a smartphone. However, the supervisor terminal 30 may be a tablet terminal, a mobile phone, a business phone (key telephone) (key telephone), a PDA (Personal Digital Assistant) (Personal Data Assistant), an audio player, a printer, a facsimile, a scanner, a copy machine, a digital Cameras, automated equipment (automated teller matine (ATM) that automatically handles things used by an unspecified number of people, automatic teller matine, vending machine, automatic ticket vending machine, kiosk terminal, etc.) Alternatively, it may be realized by other devices such as a cash processing machine (a terminal that manages cash withdrawals and withdrawals), wearable computers, car navigation systems, and the like. The supervisor terminal 30 may communicate with the server 20 by wireless communication via a mobile network such as an LTE network or wired communication via a wired network such as a LAN (Local Area Network).

[Underwater acoustic sensor 10]
The underwater acoustic sensor 10 obtains sensor data (acoustic data) by sensing the environment. Further, the underwater acoustic sensor 10 acquires information (sensor status information) indicating its own status (for example, normal, failure, unknown status, etc.). Upon obtaining the sensor data and sensor state information, the underwater acoustic sensor 10 transmits the sensing data and sensor state information to the server 20. The data formats of the sensing data and sensor status information sent to the server 20 are not limited, but include, for example, CSV (Comma-Separated Values), TSV (Tab-Separated Values) files, SSV (Space-Separated Values), and SSV (Semicolon) files. -Separated Values), HTML (HyperText Markup Language), XML (Extensible Markup Language), XHTML (Extensible HyperText Markup Language) It may be in the form of a database (dBASE or SQL (Structured Query Language)).

Here, "sensing" refers to the detection of estimated quantities such as sound, vibration (vibration), temperature, humidity, and tilt (detection of increase/decrease, amount of change, and occurrence), as well as the occurrence of smoke, chemical substances, and static electricity. This term is used to express the detection of (detection of increase/decrease, amount of change, or estimated amount). Furthermore, the term "sensing" is used to refer to not only detection but also the process of converting the detected content into a signal. Furthermore, the term "sensing" is used to mean not only detection but also measuring and determining the content of detection.

In the embodiment of the present invention, it is assumed that the underwater acoustic sensor 10 includes a plurality of acoustic sensors (microphones). Thereby, the direction of the sound source with respect to the installation position of the underwater acoustic sensor 10 can be specified based on the sound detection results from each of the plurality of acoustic sensors. Here, the specific configuration of the underwater acoustic sensor 10 is not limited. Below, a configuration example of the underwater acoustic sensor 10 will be described.

FIG. 2 is a diagram showing a configuration example of the underwater acoustic sensor 10. Referring to FIG. 2, the underwater acoustic sensor 12 as an example of the underwater acoustic sensor 10 includes, in order from the top, a transmitting buoy section 170, a weight 181, a float 182, a sensing section 130, a mooring section 150, and a power supply section. 140 and a weight portion 160. However, the arrangement order of each of these components is not limited to the example shown in FIG. 2. Furthermore, an antenna section 110, a searchlight section 121, a berthing light section 122, and a solar cell 123 are provided in the transmission buoy section 170 at a position above the sea surface.

The sensing unit 130 is located underwater and is an acoustic sensor that senses underwater. The sensing unit 130 obtains sensor data (acoustic data) through such sensing. The transmitting buoy section 170 receives buoyancy to the extent that the antenna section 110 is located above the sea surface. The antenna unit 110 transmits the sensor data transmitted via the cable from the sensing unit 130 and the sensor state information of the underwater acoustic sensor 12 to the server 20 by wireless communication.

The weight 181 and the float 182 bend or stretch the rope (including the cable) connecting the sensing section 130 and the transmitting buoy section 170, so that the transmitting buoy section 170 moves within a certain range near the sea surface. allow it. The mooring section 150 tethers the underwater acoustic sensor 12 (excluding the power supply section 140 and the weight section 160) to the power supply section 140. As a result, the underwater acoustic sensor 12 sinks to the bottom of the sea. The power supply section 140 supplies power to the antenna section 110, the sensing section 130, the searchlight section 121, and the berthing light section 122.

For example, the power supply unit 140 uses a timer function to automatically stop providing power during operating hours (for example, between 9:00:00 and 15:00:00 when fishing is carried out), and (For example, from 15:00:01 to 8:59:59 when fishing is not carried out) may automatically start providing power. This can prevent erroneous detection of a regular ship, a regular diver, etc. as a detection target.

As will be explained later, if the underwater acoustic sensor 12 has a position detection function (for example, a position detection function using GPS (Global Positioning System), etc.), the position of the underwater acoustic sensor 12 obtained by this position detection function is A location may be sent from underwater acoustic sensor 12 to server 20 . For example, the position of the underwater acoustic sensor 12 may be transmitted from the underwater acoustic sensor 12 to the server 20 at predetermined time intervals (eg, every second). Further, the position of the underwater acoustic sensor 12 may be transmitted from the underwater acoustic sensor 12 to the server 20 periodically (for example, every hour) even during operating hours. At this time, the GPS antenna may be provided at the bottom of the antenna section 110, for example, but the position where the GPS antenna is provided is not limited.

The mooring section 150 anchors the underwater acoustic sensor 12 (excluding the weight section 160) to the weight section 160. As a result, the underwater acoustic sensor 12 sinks to the bottom of the sea. The weight part 160 is an object that is heavy enough to be located on the seabed, sinks into the seabed, and moves the underwater acoustic sensor 12 (excluding the power supply part 140 and the weight part 160) to a position within a predetermined range via the mooring part 150. It suffices to be an object that can be held in place.

The searchlight section 121 illuminates the surrounding area by irradiating the surrounding area with light. Since poaching is likely to occur in a dark environment, it is expected that poaching will be suppressed by brightening the surrounding area with the searchlight unit 121. Here, the searchlight unit 121 may emit light at a predetermined time, may emit light periodically, or may emit light at random (random) arbitrary timing. However, when the sensing unit 130 obtains sensor data (acoustic data), the light may be emitted, or the light may be emitted based on an instruction from the server 20.

The berthing light section 122 calls attention to collision prevention by lighting or blinking a warning light. It is expected that the collision prevention warning provided by the berthing light section will suppress collisions of legitimate ships and poaching boats with the underwater acoustic sensor 10. Note that the berthing light section 122 may be supplied with power from the power supply section 140 or may be supplied with power from the solar cell 123 or the like. Note that the underwater acoustic sensor 12 shown in FIG. 2 has a structure that is tethered to the seabed with a mooring section 150, but the sensing section 130 can be attached to a moving body such as a drone, a small unmanned vessel, or a manned vessel. A configuration may be adopted in which sensing can be performed at different positions by moving the mobile body.

[Server 20]
Returning to FIG. 1, the explanation will be continued. Next, an example of the functional configuration of the server 20 according to the embodiment of the present invention will be described. FIG. 3 is a diagram showing an example of the functional configuration of the server 20 according to the embodiment of the present invention. As shown in FIG. 3, the server 20 according to the embodiment of the present invention includes a control section 220, a storage section 230, and a communication section 240. The control unit 220 includes an analysis unit 221 , an object detection unit 222 , a detection notification unit 223 , a request acquisition unit 224 , a data acquisition unit 225 , and a data provision unit 226 .

[Communication Department 240]
The communication unit 240 is configured with a communication interface, and communicates with the underwater acoustic sensor 10. For example, the communication unit 240 communicates with the underwater acoustic sensor 10 via a mobile network such as an LTE network. Further, the communication unit 240 may communicate with the underwater acoustic sensor 10 by other communication means such as multi-hop wireless communication means. Furthermore, the communication unit 240 communicates with the supervisor terminal 30. For example, the communication unit 240 communicates with the supervisor terminal 30 via a mobile network such as an LTE network. Alternatively, the communication unit 240 may communicate with the supervisor terminal 30 by wire.

[Storage unit 230]
The storage unit 230 is a storage device that can store programs and data for operating the control unit 220. Furthermore, the storage unit 230 can also temporarily store various data required during the operation of the control unit 220. For example, the storage device may be a non-volatile storage device. For example, the storage unit 230 can store sensor information 231 and notification destination information 232 as examples of various data. Hereinafter, the sensor information 231 will be explained with reference to FIG. 4, and the notification destination information 232 will be explained with reference to FIG.

[Sensor information 231]
FIG. 4 is a diagram showing an example of sensor information 231. As shown in FIG. 4, the sensor information 231 includes "sensor ID", "installation position information", "sensor status information", "sensor data", "weather information", and "contact name". It is configured by being associated with.

“Sensor ID” is information for uniquely identifying the underwater acoustic sensor 10.

"Installation position information" is information indicating the position where the underwater acoustic sensor 10 is installed. In the embodiment of the present invention, it is mainly assumed that the installation location information is expressed by latitude and longitude. However, the expression format of the installation position information is not limited. For example, the installation position information may be expressed in polar coordinate format. For example, the installation position information may be input manually, but if the underwater acoustic sensor 10 has a position detection function to detect its own position, the installation position information may be input by the installation position detected by the underwater acoustic sensor 10. may be set based on. Further, as described above, when the position of the underwater acoustic sensor 10 is transmitted from the underwater acoustic sensor 10 to the server 20 at predetermined time intervals, the server 20 transmits the position of the underwater acoustic sensor 10 that is received from the underwater acoustic sensor 10. The installation position information may be updated at predetermined time intervals based on.

“Sensor status information” and “sensor data” are registered in the sensor information 231 when received from the underwater acoustic sensor 10. If a “sensor ID” is attached to the “sensor status information” and “sensor data” received from the underwater acoustic sensor 10, the “sensor ID” is the same as the “sensor ID” received from the underwater acoustic sensor 10. The associated “sensor status information” and “sensor data” are registered in the sensor information 231.

“Weather information” is information regarding the weather according to the installation position of the underwater acoustic sensor 10. Weather information may be obtained in any manner. For example, weather information according to the installation position of the underwater acoustic sensor 10 may be periodically acquired from a predetermined web page and registered in the sensor information 231. The weather depending on the installation position of the underwater acoustic sensor 10 may be the weather of the installation position of the underwater acoustic sensor 10 itself, or the weather at a place far from the installation position of the underwater acoustic sensor 10 (for example, a place where the underwater acoustic sensor 10 is installed). It may also be the weather of the area under its jurisdiction (e.g. the area under its jurisdiction). In the embodiment of the present invention, it is assumed that the weather information includes weather (for example, wind strength, weather, etc.), temperature, humidity, precipitation, wind speed, and the like. Weather conditions include sunny, cloudy, rain and snow, and an approaching typhoon. For example, even though the weather indicates that a typhoon is approaching, if you are notified that a poacher or a poaching boat has been detected (because it is considered difficult to carry out poaching while a typhoon is approaching), Notifications of detection of poachers or poaching vessels may be determined to be false alarms. However, there is no particular limitation on what kind of information the weather information specifically includes.

“Contact name” corresponds to the name of the contact (observer to be contacted) corresponding to the underwater acoustic sensor 10. For example, the supervisor may use the supervisor terminal 30 to select in advance the underwater acoustic sensors 10 installed in the area (area) that the supervisor wishes to monitor. Thereby, the name of the supervisor is associated as a "contact name" with the "sensor ID" of the underwater acoustic sensor 10 selected by the supervisor.

In the example shown in FIG. 4, sensor 1 and sensor 2 are installed in the same area, and sensor 3 is installed in a different area from the area where sensor 1 and sensor 2 are installed. Assume that At this time, "Mr. A" and "Mr. B" correspond to persons who intend to monitor only a specific area (for example, a specific fishing cooperative). "Mr. C" corresponds to a person who attempts to monitor multiple areas (for example, the National Federation of Fisheries Cooperatives, etc.).

[Notification destination information 232]
FIG. 5 is a diagram showing an example of notification destination information 232. As shown in FIG. As shown in FIG. 5, the notification information 232 is configured by associating a "contact name", a "notification address", and a "contact telephone number". For example, the notification destination information 232 may be set in advance by the supervisor using the supervisor terminal 30.

The “contact name” corresponds to the name of the contact (observer who should be contacted) corresponding to the underwater acoustic sensor 10, similar to the “contact name” of the sensor information 231.

The “notification destination address” is an address indicating a detection notification destination when a detection target object is detected by the underwater acoustic sensor 10. In the embodiment of the present invention, it is assumed that the detection notification means is an e-mail (detection mail). That is, it is mainly assumed that an e-mail address is used as the "notification destination address." However, the "notification destination address" is not limited to an email address.

For example, as will be explained later, since a detection notification needs to include a character string, the detection notification means may be any means that can send a character string. For example, the detection notification means may be a predetermined application capable of transmitting a character string. For example, if the detection notification means is an SNS (Social Networking Service) application, the notification destination address may be an SNS account. Alternatively, for example, if the detection notification means is a short mail, the notification destination address may be a telephone number.

“Contact telephone number” corresponds to the telephone number of the contact (observer to be contacted) corresponding to the underwater acoustic sensor 10.

[Control unit 220]
The control unit 220 includes an arithmetic device such as a CPU (Central Processing Unit), and its functions are realized by the arithmetic device loading a program stored in a ROM (Read Only Memory) into a RAM and executing it. obtain. At this time, a computer-readable recording medium on which the program is recorded may also be provided. Alternatively, these blocks may be configured by dedicated hardware or a combination of multiple pieces of hardware. Data necessary for calculation by the calculation device is appropriately stored in the storage unit 230.

Note that the analysis section 221, object detection section 222, detection notification section 223, request acquisition section 224, data acquisition section 225, and data provision section 226 will be described in detail later.

[Supervisor terminal 30]
Returning to FIG. 1, the explanation will be continued. Next, an example of the functional configuration of the supervisor terminal 30 according to the embodiment of the present invention will be described. FIG. 6 is a diagram showing an example of the functional configuration of the supervisor terminal 30 according to the embodiment of the present invention. As shown in FIG. 6, the supervisor terminal 30 according to the embodiment of the present invention includes an input section 310, a control section 320, a storage section 330, a communication section 340, and a display section 350.

[Input section 310]
Input unit 310 accepts operations by a supervisor. In the embodiment of the present invention, it is mainly assumed that the input unit 310 is a touch panel. However, the type of input section 310 is not limited. For example, the input unit 310 may include a keyboard, a mouse, an electronic pen, or other input devices.

[Control unit 320]
The control unit 320 includes a CPU and the like, and its functions can be realized by the program stored in the storage unit 330 being loaded into the RAM and executed by the CPU. At this time, a computer-readable recording medium on which the program is recorded may also be provided. Alternatively, the control unit 320 may be configured with dedicated hardware or a combination of multiple pieces of hardware. Data necessary for calculation by the calculation device is appropriately stored in the storage unit 330.

[Storage unit 330]
The storage unit 330 is a storage device that can store programs and data for operating the control unit 320. Furthermore, the storage unit 330 can also temporarily store various data required during the operation of the control unit 320. For example, the storage device may be a non-volatile storage device.

[Communication Department 340]
The communication unit 340 is configured with a communication interface and communicates with the server 20. The communication unit 340 communicates with the server 20 via a mobile network such as an LTE network. Alternatively, the communication unit 340 may communicate with the server 20 by wire.

[Display section 350]
The display section 350 has a function of displaying under the control of the control section 320. Here, the form of the display section 350 is not particularly limited. For example, the display unit 350 may be a CRT (Cathode Ray Tube) display device, a Liquid Crystal Display (LCD) device, an OLED (Organic Light Emitting Diode) device, or It may also be a display device such as a lamp.

[Analysis Department 221]
Returning to FIG. 3, the explanation will be continued. Based on the sensor data (acoustic data) obtained by the underwater acoustic sensor 10, the analysis unit 221 analyzes the sound intensity for each sound frequency and the time at which the sound was detected, and generates an analysis result (hereinafter referred to as a "spectrogram"). ). An example of a spectrogram obtained by analysis by the analysis unit 221 will be described with reference to FIG. 7.

FIG. 7 is a diagram showing a first example of a spectrogram obtained by analysis by the analysis unit 221. In the spectrogram shown in FIG. 7, the vertical axis shows the frequency of the sound, the horizontal axis shows the time when the sound was detected, and the intensity of the sound is shown at the position corresponding to the frequency and time. Note that the greater the intensity of the sound, the darker the black color. In the example shown in FIG. 7, it is understood that sounds are detected in each of areas D11 to D13, which are formed by combinations of frequencies and times. More specifically, the sounds corresponding to each of areas D11 to D13 are sounds emitted by a diver.

FIG. 8 is a diagram showing a second example of a spectrogram obtained by analysis by the analysis unit 221. In the spectrogram shown in FIG. 8, similarly to the spectrogram shown in FIG. 7, the vertical axis shows the frequency of the sound, the horizontal axis shows the time when the sound was detected, and the position corresponding to the frequency and time is The intensity of the sound is indicated. Note that the greater the intensity of the sound, the darker the black color. In the example shown in FIG. 8, it is understood that sounds are detected in each of areas D21 to D22, which are formed by combinations of frequencies and times. More specifically, the sounds corresponding to each of areas D21 to D22 are sounds emitted by marine organisms.

Returning to FIG. 3, the explanation will be continued. Based on the sensor data (acoustic data) obtained by the underwater acoustic sensor 10, the analysis unit 221 determines whether the intensity of the sound is greater than a predetermined first threshold value for each frequency and time, and makes a determination. The results obtained may be obtained as analysis results (hereinafter also referred to as "sound patterns"). An example of a sound pattern obtained by analysis by the analysis unit 221 will be described with reference to FIG. 9.

FIG. 9 is a diagram showing an example of a sound pattern obtained by analysis by the analysis unit 221. In the sound pattern shown in FIG. 9, the vertical axis indicates the frequency of the sound, the horizontal axis indicates the time at which the sound was detected, and whether the sound intensity is greater than the first threshold at a position corresponding to the frequency and time. It is shown whether or not. Note that "1" indicates that the sound intensity is greater than the first threshold, and "0" indicates that the sound intensity is less than or equal to the first threshold.

In the example shown in FIG. 9, as time passes, the frequency band in which sounds whose intensity is greater than the first threshold value is detected (i.e., the frequency band in which "1" stands in the sound pattern) becomes wider. It is understood that there are This is because the ship is approaching the acoustic sensor 10 and the sound emitted by the ship is gradually being detected in a wider frequency band. Note that the beam number is a number assigned to each of a plurality of detection directions.

[Target detection unit 222]
Returning to FIG. 3, the explanation will be continued. The object detection unit 222 detects a detection object based on sensor data (acoustic data) obtained by the underwater acoustic sensor 10.

For example, there is a first detection target that emits a sound having a characteristic that a frequency band in which the sound intensity is higher than a first threshold value is wider than a predetermined first band. Therefore, the target object detection unit 222 detects a first frequency band in which the sound intensity is higher than the first threshold, and based on the fact that the first frequency band is wider than the predetermined first band, A first detection target can be detected.

More specifically, the first detection target detects a sound at a time (second time) that is a predetermined time after a time (first time) at which a frequency where the sound intensity is greater than a first threshold exists. A sound is emitted having a characteristic that a first frequency band whose intensity is greater than a first threshold is wider than the first frequency band. Therefore, the target object detection unit 222 detects a first time at which there is a frequency where the sound intensity is higher than the first threshold value, and detects the sound intensity at a second time after a predetermined time from the first time. A frequency band larger than the first threshold may be detected as the first frequency band.

For example, in the example shown in FIG. 9, if the time at which a frequency with a sound intensity greater than the first threshold value exists is "1 second" and the predetermined time is "5 seconds", the object detection unit 222 detects a frequency band in which the sound intensity at "6 seconds" is greater than the first threshold value as the first frequency band, and based on the fact that the first frequency band is wider than the predetermined first band. , the first detection target can be detected.

Although the first detection target is not particularly limited, in the embodiment of the present invention, it is assumed that the target detection unit 222 detects a ship as the first detection target. At this time, the sounds emitted by the ship may include mechanical sounds emitted by the ship due to the engine rotation, water cutting sounds emitted by the ship due to the rotation of the screw, and the like. Note that assuming that the ship detected by the target object detection unit 222 is a poaching boat, the ship detected by the target object detection unit 222 will also be referred to as a “poaching boat” below. Furthermore, the term "ship" is a concept that broadly encompasses any moving body that has a power source that floats on the surface of water, and may also include watercraft and the like.

Furthermore, there may also be a second detection target object that is difficult to detect based on predetermined rules. For example, in the example shown in FIG. 7, it can be assumed that the sounds emitted by the divers corresponding to each of areas D11 to D13 are small, making it difficult to detect the sounds emitted by the divers. In such a case, the target object detection unit 222 can detect the second detection target based on a model generated in advance by machine learning and a spectrogram.

More specifically, a case is assumed in which the model inputs the spectrogram and outputs the detection probability of the second detection target. In such a case, the target object detection unit 222 detects the second detection target based on the fact that the detection probability of the second detection target output based on the spectrogram and the model generated by machine learning in advance is larger than the predetermined probability. A second detection target may also be detected.

The type of machine learning algorithm is not limited. For example, the machine learning algorithm may be a neural network or other machine learning algorithm. In addition, in the learning stage, the learning spectrogram is used as input data, and the value "1" indicating that the learning spectrogram includes the sound emitted by the second detection object or the sound emitted by the second detection object is used. A model may be generated by setting the value "0" indicating that the value is not included as correct data.

Although the second detection target is not particularly limited, in the embodiment of the present invention, it is assumed that the target detection unit 222 detects a diver (that is, a person) as the second detection target. At this time, the sound emitted by the diver may include the sound of air passing through a regulator when the diver sucks air from the cylinder. Note that assuming that the diver detected by the object detection unit 222 is a poacher, the diver detected by the object detection unit 222 will also be referred to as a "poacher" below.

There may also be marine life that makes sounds similar to those made by divers. Therefore, detection of sounds emitted by marine life may lead to false positives that sounds emitted by divers have been detected. Therefore, when sounds emitted by marine life are detected, it is desirable to cancel the detection of sounds emitted by divers.

For example, the sounds emitted by marine creatures corresponding to each of areas D21 to D22 shown in FIG. Has characteristics. Therefore, the object detection unit 222 detects a second frequency band in which the sound intensity is higher than the second threshold, and detects a diver based on the fact that the second frequency band is wider than the second frequency band. You may cancel it.

Furthermore, the sounds emitted by marine creatures corresponding to each of the areas D21 to D22 shown in FIG. 8 have a characteristic that the time during which the intensity is greater than a predetermined second threshold is shorter than a predetermined time. Therefore, the object detection unit 222 may detect a time when the sound intensity is higher than the second threshold, and cancel the detection of the diver based on the fact that the time is shorter than a predetermined time.

Note that the target object detection unit 222 detects that the second frequency band in which the sound intensity is greater than the second threshold value is wider than the second frequency band, and that the time period in which the sound intensity is greater than the second threshold value is a predetermined period. Detection of the diver may be canceled based on less than the time. This increases the accuracy of detecting sounds emitted by marine organisms, and can reduce the possibility that detection of sounds emitted by marine organisms will lead to false positives that sounds emitted by divers have been detected.

As described above, the object detection unit 222 can identify the direction of the sound source (that is, the object to be detected) with respect to the installation position of the underwater acoustic sensor 10 based on the sensor data. Note that it is also assumed that the same detection target object is detected by a plurality of underwater acoustic sensors 10 at the same time. In such a case, the object detection unit 222 can identify the orientation of the object to be detected based on each of the installation positions of the plurality of underwater acoustic sensors 10. At this time, the target object detection unit 222 determines the position of the detection target based on the orientation of the detection target with respect to each of the installation positions of the plurality of underwater acoustic sensors 10 and the installation positions of the plurality of underwater acoustic sensors 10. (latitude and longitude) can be specified.

In the embodiment of the present invention, it is mainly assumed that the target object detection unit 222 is present in the server 20. However, if an analysis device (not shown) is present between the underwater acoustic sensor 10 and the server 20, the target object detection unit 222 may be incorporated in the analysis device. In such a case, the analysis device receives sensor data obtained by the underwater acoustic sensor 10. When the analyzer detects a detection target based on the acquired sensor data, the analyzer includes the orientation or position information of the detection target, the type of the detection target, and the information of the underwater acoustic sensor 10 where the detection target was detected. What is necessary is just to transmit the sensor ID to the server 20.

[Detection notification unit 223]
The detection notification unit 223 outputs an alarm based on the detection of a detection target by the target object detection unit 222 (that is, based on the detection of a ship or a diver by the target object detection unit 222). ). More specifically, the detection notification unit 223 informs the supervisor terminal 30 (or Specifically, the communication unit 240 is controlled so that the sensor information 231 is transmitted to the supervisor terminal 30) indicated by the "notification destination address" associated with the "sensor ID" of the underwater acoustic sensor 10. As a result, the supervisor terminal 30 is notified of the detection of the object to be detected. Identification information may correspond to an example of an alarm.

In the following, it is assumed that the identification information is a URL (Uniform Resource Locator) indicating the location of information related to detection. The URL indicating the location of information related to detection is formed based on the document RFC (Request For Comment) (for example, RFC2396 and RFC3986) issued by the Internet Engineering Task Force (IETF), an organization that sets standards for Internet-related technology. Good too. For example, RFC3986 indicates that the general URI (Uniform Resource Identifier) syntax consists of a hierarchical sequence of components called scheme, authority, path, query, and fragment, and "URI=scheme":"hier-part" [ ”? "query" ["#"fragment]". The URL indicating the location of information regarding detection is, for example, "https://sensor.server.jp/poaching/999." The URL "https://sensor.server.jp/poaching/999" indicating the location of information related to detection is the identification information (scheme name) "https" representing the scheme (scheme), the HTTP (HyperText Transfer Protocol) server (server 20) Identification information representing an address (host name) "sensor.server.jp" and identification information representing a path "/poaching/999" ("999" is identification information representing a program or web page that provides information regarding detection) It is made up of. However, the identification information is not limited to a URL as long as it is information that can identify information related to detection. For example, the identification information may be characters or images corresponding to a URL indicating the location of information related to detection. In this case, the characters, images, etc. corresponding to the URL indicating the location of the information related to detection may be different from the characters, images, etc. corresponding to the URL indicating the location of the information related to detection.

As described above, the means of notification of detection is not limited, but when the detection is notified by a detection mail (email), the detection notification unit 223 detects the Control may be performed so that the e-mail is sent to the supervisor terminal 30. In addition, when detection is notified by a detection email (HTML email), the detection notification unit 223 sends a detection email to the supervisor terminal 30 that includes text, images, etc. corresponding to the URL indicating the location of information regarding the detection. All you have to do is control it so that it is sent. Note that a specific example of information regarding detection will be explained later.

[Detected email]
FIG. 10 is a diagram showing an example of a detection email. As shown in FIG. 10, the detection email G10 includes a sender, a subject, a sending date and time (of the detection email), a destination (of the detection email), and a body. The text describes "poaching boat" and "poacher" as examples of the types of objects to be detected. Further, a URL (B10) (https://sensor.server.jp/poaching/999) indicating the location of information regarding detection is described. In the supervisor terminal 30, the control unit 320 controls the display unit 350 so that the detection email G10 is displayed on the display unit 350 when the communication unit 340 receives the detection email G10. Note that when the supervisor terminal 30 (control unit 320) receives the detection email G10, it may be controlled to automatically display the detection email G10, or the supervisor terminal 30 (control unit 320) may control the display of the detection email G10 automatically according to the operation of the supervisor. may be controlled to display.

The monitor performs a selection operation of the URL (B10) on the input unit 310 at a timing when he or she wants to check information regarding detection. For example, if the input unit 310 includes a touch panel, the selection operation may be a tap operation on the touch panel. Alternatively, if the input unit 310 includes a mouse, the selection operation may be a click operation using the mouse. In addition, the selection operation may be changed as appropriate depending on the type of input section 310. Note that if the URL (B10) indicating the location of information related to detection is text or an image that corresponds to the URL indicating the location of information related to detection, the monitor can check the information related to detection at the timing when he/she wants to check the information related to detection. A user performs an operation on the input unit 310 to select characters, images, etc. corresponding to a URL indicating the location of information about the user.

When the input unit 310 accepts a URL selection operation (selection operation of characters, images, etc. corresponding to the URL), the control unit 320 sends a data transmission request corresponding to the URL (characters, images, etc. corresponding to the URL) to the server. 20. For example, as a data transmission request (HTTP message), the control unit 320 includes a GET method (letters "GET") and a request target "https://sensor.server.jp/poaching/999" (letters) in the request line. The communication unit 340 is controlled so that the HTTP GET request sent is sent to the server 20. Here, the request target "https://sensor.server.jp/poaching/999" in the data transmission request is a URL (B10) indicating the location of the information regarding detection included in the detection email G10.

In addition, if the supervisor contacts another person using some contact function (e.g., telephone function, email function, etc.) on the supervisor terminal 30 within a predetermined time after the supervisor performs the selection operation, the supervisor will not contact you. The name (contact name) of the other person and contact information (notification address and/or contact telephone number) of the other person may be notified from the supervisor terminal 30 to the server 20. At this time, the server 20 newly registers the name of the other person notified from the supervisor terminal 30 as a "contact name" in the sensor information 231 (FIG. 4), and The name and contact information of the other person may be newly registered in the notification information 232 (FIG. 5) as "contact name" and "notification address (and/or contact telephone number)." Then, the server 20 may send the detection email G10 to the other person in addition to the monitor based on the newly registered contact information of the other person. By newly registering in the notification destination information 232 (FIG. 5), the server 20 can resend the detection email G10 that has already been sent to the supervisor terminal 30 to the notification destination address of the other person. When newly sending the detection mail G10 to the terminal 30, it becomes possible to include the notification destination address of the other person.

[Request acquisition unit 224]
Returning to FIG. 3, the explanation will be continued. In the server 20 , when the communication unit 240 receives the data transmission request corresponding to the URL from the supervisor terminal 30 , the request acquisition unit 224 acquires the data transmission request corresponding to the URL from the communication unit 240 .

[Data acquisition unit 225]
The data acquisition unit 225 acquires information regarding detection corresponding to the URL when the request acquisition unit 224 acquires a data transmission request corresponding to the URL. In the embodiment of the present invention, a case is assumed in which the information regarding detection includes a map according to the installation position of the underwater acoustic sensor 10 where the detection target object is detected.

Note that the embodiment of the present invention mainly assumes a case where the data acquisition unit 225 acquires a map from a predetermined map providing API (Application Programming Interface). In such a case, the data acquisition unit 225 notifies the map providing API of the reference point of the map to be acquired and the map range (for example, zoom) centered on the reference point, and then A map of the range can be obtained from the map provision API.

Therefore, the map providing API is a specification of an interface for mutual interaction between the map providing program that manages and provides map information and the data acquisition unit 225, and is a specification of an interface for mutual interaction between the map providing program that manages and provides map information and the data acquisition unit 225. This is a program that intervenes between the two. The map providing API may be internal to the map providing program, or may exist as a separate program from the map providing program.

Further, the map providing program and the map providing API may be placed on the server 20 or may be placed on an external server other than the server 20. When the map providing program and the map providing API are arranged in the server 20, map information is stored in the storage unit 230, and the data acquisition unit 225 can acquire the map from the storage unit 230 via the map providing API. When the map providing program and the map providing API are placed in an external server other than the server 20, the map information is stored in the external server, and the data acquisition unit 225 accesses the external server via the network and the map providing API. Maps can be obtained from.

For example, when the map providing program and the map providing API are located on an external HTTP server other than the server 20, and the data acquisition unit 225 obtains a map from a predetermined map providing API, HTTP can be used. In this case, the external HTTP server is a map providing server that manages map information and provides maps over the network based on the HTTP communication protocol, so the map providing API can be referred to as the map providing Web API (map providing web service). You may.

Here, the reference point may be an installation position of the underwater acoustic sensor 10 that is associated with the supervisor terminal 30 in advance. At this time, it is desirable that the range of the map is determined so that the detectable range of the underwater acoustic sensor 10 associated with the supervisor terminal 30 in advance falls within the range.

Alternatively, if there are multiple underwater acoustic sensors 10 associated with the supervisor terminal 30 in advance, the reference point may be a position (for example, a center of gravity position, etc.) that corresponds to the installation position of the multiple underwater acoustic sensors 10. good. At this time, it is desirable that the range of the map is determined so that the detectable range of all of the plurality of underwater acoustic sensors 10 associated with the supervisor terminal 30 in advance falls within the range.

Alternatively, the reference point may be the installation position of the underwater acoustic sensor 10 that has detected the detection target among one or more underwater acoustic sensors 10 associated with the supervisor terminal 30 in advance. At this time, it is desirable that the range of the map is determined so that the detectable range of the underwater acoustic sensor 10 in which the detection target object is detected falls within.

Furthermore, in the embodiment of the present invention, it is assumed that the information regarding detection includes additional information other than the map. However, the information regarding detection only needs to include at least one of a map and additional information.

In the embodiment of the present invention, it is assumed that the additional information includes a contact name and a contact telephone number (FIG. 5) that are associated in advance with the underwater acoustic sensor 10 in which the detection target object is detected. Note that the contact name and contact phone number are examples of information related to the notification destination, so instead of the notification destination name and contact phone number, information related to other notification destinations (for example, notification destination address, etc.) may be added. May be included in the information.

Furthermore, in the embodiment of the present invention, a case is assumed in which the additional information includes sensor state information (FIG. 4) of the underwater acoustic sensor 10 in which the detection target object is detected. Further, in the embodiment of the present invention, a case is assumed in which the additional information includes weather information according to the installation position of the underwater acoustic sensor 10 where the detection target object is detected.

Furthermore, in the embodiment of the present invention, it is assumed that the additional information includes the date and time of sending the detection email to the supervisor terminal 30 (the date and time of sending the detection email). However, the additional information may include the detection date and time of the detection target (detection date and time of the detection target) instead of or in addition to the date and time of the detection email sent to the supervisor terminal 30. and the detection time of the detection target).

[Data providing unit 226]
The data providing unit 226 controls the communication unit 240 so that information regarding detection is transmitted to the supervisor terminal 30. For example, the data providing unit 226 controls the communication unit 240 so that an HTTP response including information regarding detection is returned to the supervisor terminal 30 as a response to the HTTP GET request.

[Detection screen]
In the supervisor terminal 30, when the communication unit 340 receives the information regarding detection, the control unit 320 acquires the information regarding the detection. The control unit 320 controls the display unit 350 so that the detection screen is displayed on the display unit 350 based on the information regarding detection. By viewing the detection screen displayed on the display unit 350, the supervisor can grasp information regarding detection. Examples of detection screens will be described below with reference to FIGS. 11 to 16.

FIG. 11 is a diagram showing an example of a detection screen G20 when a detection target object is detected by one underwater acoustic sensor 10. Referring to FIG. 11, the detection screen G20 includes an area where a map is displayed (map display area W21) and an area where additional information is displayed (additional information display area W22). Referring to the map display area W21, the data acquisition unit 225 displays an object (sensor Object B211) is added.

Referring to the map display area W21, the data acquisition unit 225 attaches an object (poacher detection direction object D211) based on the sensor position on the map to the direction on the map corresponding to the direction of the poacher. . Further, when referring to the map display area W21, the data acquisition unit 225 adds an object (poaching boat detection direction object D212) based on the sensor position on the map in the direction on the map corresponding to the direction of the poaching boat. ing.

In the example shown in FIG. 11, the poacher detection direction object D211 and the poaching boat detection direction object D212 are distinguished by different colors and sizes, but the poacher detection direction object D211 and the poaching boat detection direction object D212 The detection direction object D212 may be distinguished by other aspects. For example, the poacher detection direction object D211 and the poaching boat detection direction object D212 may be distinguished by a difference in shape.

Furthermore, in the example shown in FIG. 11, the shapes of the poacher detection direction object D211 and the poaching boat detection direction object D212 are fan-shaped, but the shapes of the poacher detection direction object D211 and the poaching boat detection direction object D212 are is not limited. For example, the shape of each of the poacher detection direction object D211 and the poaching boat detection direction object D212 may be a triangle whose apex is located at the sensor position on the map.

Further, referring to the map display area W21, the map includes an object (display size adjustment object D272) for adjusting the display size of the map. Accordingly, by inputting an enlargement or reduction operation into the input section 310 using the display size adjustment object D272, the observer can receive an enlarged or reduced map from the server 20 to the monitor terminal 30, and the display section 350, the enlarged or reduced map is newly displayed.

Furthermore, referring to the map display area W21, the map includes a width on the map corresponding to the width in real space as a scale bar. "100 m" is displayed as an example of the width in real space. By checking the scale bar, the observer can grasp the correspondence between the width on the map and the width in real space. In addition, referring to the map display area W21, a display switching object B210 is added to the map by the data acquisition unit 225. The display switching object B210 will be explained later.

The additional information display area W22 includes "last update date and time" indicating the date and time when the map was last updated. Further, the additional information display area W22 includes "Status: Detecting poaching" indicating the status of the system. Further, the additional information display area W22 includes an additional information display switching button B221. The additional information display switching button B221 will be explained later. In addition, the additional information display area W22 includes "detection mail sending date and time", but as mentioned above, it can be used instead of "detection mail sending date and time" or in addition to "detection mail sending date and time". , the detection date and time of the detection target may be included.

Further, the additional information display area W22 includes a clear button B222. The monitor can cause the server 20 to clear the detected email transmission date and time by inputting a selection operation of the clear button B222 into the input unit 310. Once the detection email is sent to the supervisor terminal 30, it is usual that the detection email is not sent to the supervisor terminal 30 for a certain period of time even if the object to be detected is detected again. However, after the clear button B222 is selected, a detection email is sent to the supervisor terminal 30 at the timing when the detection target is detected again, even if a certain period of time has not passed.

Additionally, the additional information display area W22 includes a "contact list". The "contact list" is a list of contact names and contact phone numbers (FIG. 5) that are associated in advance with the underwater acoustic sensor 10 in which the detection target object has been detected. However, as mentioned above, the contact name and contact phone number are examples of information about the notification destination, so instead of the notification destination name and contact phone number, other notification destinations (e.g., security companies, police etc.) (for example, notification destination address, etc.) may be included in the additional information display area W22.

The additional information display area W22 also includes an audio playback button B224. When the supervisor inputs a selection operation of the audio reproduction button B224 into the input unit 310, the supervisor terminal 30 transmits a reproduction request to the server 20. Based on receiving a playback request from the supervisor terminal 30 via the communication unit 240, the data providing unit 226 plays back the recorded data when the object to be detected was detected by the object detection unit 222, and the data is played back. The communication unit 240 is controlled so as to provide the supervisor terminal 30 with the sound. In the supervisor terminal 30, the display unit 350 outputs the reproduced sound.

This allows the observer to confirm with his or her hearing whether the sound of a ship or diver or some other sound has been detected.

The additional information display area W22 also includes a spectrogram reference button B225. When the monitor inputs a selection operation of the spectrogram reference button B225 into the input unit 310, the monitor terminal 30 transmits a spectrogram transmission request to the server 20. The data providing unit 226 controls the communication unit 240 to provide the spectrogram to the supervisor terminal 30 based on receiving a spectrogram transmission request from the supervisor terminal 30 via the communication unit 240 . In the supervisor terminal 30, the display unit 350 displays a spectrogram.

FIG. 12 is a diagram showing an example of a spectrogram displayed by the supervisor terminal 30. Referring to FIG. 12, in addition to displaying a spectrogram, a start date selection field B231, a start time selection field B232, an end date selection field B233, an end time selection field B234, an acoustic sensor selection field B235, and a display button B236 are provided. ing.

The start date selection field B231 is a selection field for selecting the start date of the spectrogram to be displayed. The start time selection field B232 is a selection field for selecting the start time of the spectrogram to be displayed. The end date selection field B233 is a selection field for selecting the end date of the displayed spectrogram. The end time selection field B234 is a selection field for selecting the end time of the displayed spectrogram.

The acoustic sensor selection field B235 is a selection field for selecting which acoustic sensor will display the spectrogram of the sound detected. Display button B236 is a button for starting display of a spectrogram. Note that here, it is assumed that the observer specifies the time width from the start to the end of the displayed spectrogram. However, it is assumed that the time width in which sound characteristics appear differs depending on the type of object to be detected. Therefore, the data providing unit 226 may decide the time width from the start to the end of the displayed spectrogram depending on the type of the detection target. As an example, it is assumed that the time range in which the characteristics of the sound appear is narrower in the sound emitted by a diver than in the sound emitted by a ship. Therefore, the data providing unit 226 may narrow the time width from the start to the end of the displayed spectrogram when the detection target is a diver than when the detection target is a ship.

Referring to FIG. 12, atmospheric pressure, water temperature, and wind force are also displayed. That is, based on receiving a spectrogram transmission request from the supervisor terminal 30 via the communication unit 240, the data providing unit 226 provides information on atmospheric pressure, water temperature, and wind power according to the position of the acoustic sensor 10, in addition to the spectrogram. The communication unit 240 may be controlled to provide at least one of them to the supervisor terminal 30. Since it is assumed that the state of sound detection by the acoustic sensor 10 may change depending on atmospheric pressure, water temperature, wind power, etc., information such as atmospheric pressure, water temperature, wind power, etc. may also be useful for the observer.

Note that the atmospheric pressure, water temperature, and wind power may be the atmospheric pressure, water temperature, and wind power at the installation position of the underwater acoustic sensor 10, or at a place away from the installation position of the underwater acoustic sensor 10 (for example, at a place where the underwater acoustic sensor 10 is installed). It may also be the atmospheric pressure, water temperature, or wind force of the area under its jurisdiction (e.g., the area under its jurisdiction). The atmospheric pressure, water temperature, and wind force may be obtained in any manner. For example, the atmospheric pressure, water temperature, and wind force depending on the position of the underwater acoustic sensor 10 may be acquired from a predetermined web page.

Returning to FIG. 11, the explanation will be continued. The additional information display area W22 also includes a sound pattern reference button B226. When the supervisor inputs a selection operation of the sound pattern reference button B226 into the input unit 310, the supervisor terminal 30 transmits a sound pattern transmission request to the server 20. The data providing unit 226 controls the communication unit 240 to provide the sound pattern to the supervisor terminal 30 based on receiving a sound pattern transmission request from the supervisor terminal 30 via the communication unit 240 . In the supervisor terminal 30, the display section 350 displays the sound pattern.

FIG. 13 is a diagram showing an example of a sound pattern displayed by the supervisor terminal 30. Referring to FIG. 13, in addition to displaying the sound pattern, similar to the example shown in FIG. 12, a start date selection field B231, a start time selection field B232, an end date selection field B233, an end time selection field B234, An acoustic sensor selection field B235 and a display button B236 are provided. Furthermore, in the example shown in FIG. 13, a scroll bar B234 is provided.

The start date selection field B231 is a selection field for selecting the start date of the displayed sound pattern. The start time selection field B232 is a selection field for selecting the start time of the displayed sound pattern. The end date selection field B233 is a selection field for selecting the end date of the displayed sound pattern. The end time selection field B234 is a selection field for selecting the end time of the displayed sound pattern.

The acoustic sensor selection field B235 is a selection field for selecting which sound sensor detects the sound pattern of the sound to be displayed. The display button B236 is a button for starting display of a sound pattern. The scroll bar B234 is a scroll bar for scrolling the displayed time of the sound pattern. Note that here, it is assumed that the observer specifies the time width from the start to the end of the displayed sound pattern. However, it is assumed that the time width in which sound characteristics appear differs depending on the type of object to be detected. Therefore, the data providing unit 226 may decide the time width from the start to the end of the displayed sound pattern depending on the type of the detection target. As an example, it is assumed that the time range in which the characteristics of the sound appear is narrower in the sound emitted by a diver than in the sound emitted by a ship. Therefore, the data providing unit 226 may narrow the time width from the start to the end of the displayed sound pattern when the detected object is a diver than when the detected object is a ship. Further, referring to FIG. 13, similar to FIG. 12, atmospheric pressure, water temperature, and wind force are also displayed.

Note that in the example shown in FIG. 13, positions corresponding to frequencies and times where the sound intensity is greater than the first threshold are colored, and positions corresponding to frequencies and times where the sound intensity is less than or equal to the first threshold are colored. Corresponding positions are not colored. As in this example, there are display modes for positions corresponding to frequencies and times at which the sound intensity is greater than the first threshold, and display modes for positions corresponding to frequencies and times at which the sound intensity is less than or equal to the first threshold. By having different values, the observer can intuitively understand the correspondence between the sound intensity, frequency, and time.

Further, the additional information display area W22 also includes a detected mail history button B227. When the supervisor inputs a selection operation of the detected mail history button B227 into the input section 310, the supervisor terminal 30 transmits a detected mail history transmission request to the server 20. Based on receiving a detection email history transmission request from the supervisor terminal 30 via the communication unit 240, the data providing unit 226 causes the communication unit 240 to provide the history of the detection email transmission time to the supervisor terminal 30. control. In the supervisor terminal 30, the display unit 350 displays the history of detection email transmission times. This allows the monitor to grasp the history of the detection email sending times.

Furthermore, the additional information display area W22 also includes a download button B228. When the supervisor inputs a selection operation of the download button B228 into the input unit 310, the supervisor terminal 30 transmits a download request to the server 20. Based on receiving a download request from the supervisor terminal 30 via the communication unit 240, the data providing unit 226 transmits the voltage of the power supply unit 140 of the acoustic sensor 10 and the position of the acoustic sensor 10 to the supervisor terminal 30. The communication unit 240 is controlled to provide the following information. In the supervisor terminal 30, the display section 350 displays the voltage of the power supply section 140 and the position of the acoustic sensor 10. This allows the observer to grasp how much power is left in the power supply section 140 and where the acoustic sensor 10 is located.

FIG. 14 is a diagram illustrating an example when a selection operation for the display switching object B210 is input. The display switching object B210 is an object for switching between displaying and non-displaying information regarding the underwater acoustic sensor 10. The display switching object B210 is added to the map by the data acquisition unit 225.

In the example shown in FIG. 14, the sensor name D217 of the underwater acoustic sensor 10 is added to the map as an example of information regarding the underwater acoustic sensor 10. Other examples of information related to the underwater acoustic sensor 10 include information D215 related to the acoustic sensor that detected the poacher (“detection time” of the poacher, “direction” of the poacher based on the sensor, “radius” of the poacher detection range). "), and information D216 regarding the acoustic sensor that detected the poaching boat ("detection time" of the poaching boat, "direction" of the poaching boat based on the sensor, and "radius" of the poaching boat detection range) are added to the map. ing.

Note that when a deselection of the display switching object B210 is input, the sensor name D217, the information D215 about the acoustic sensor that detected the poacher, and the information D216 about the acoustic sensor that detected the poaching boat are hidden. It's fine.

FIG. 15 is a diagram showing an example when the additional information display area W22 is scrolled. Here, it is assumed that the observer inputs a downward scroll operation of the additional information display area W22 into the input unit 310. At this time, the additional information display area W22 includes "weather information" and "map legend".

The "map legend" describes a change in the aspect of the sensor object B211 according to the sensor state information. Here, a case is shown in which the shape of the sensor object B211 changes depending on the sensor state information. However, the way the data acquisition unit 225 changes the aspect of the sensor object B211 according to the sensor state information is not limited to this example. For example, the sensor object B211 may change color depending on the sensor state information. Alternatively, text data indicating sensor state information may be added to the sensor object B211 (for example, as a speech bubble).

Here, it is assumed that the supervisor inputs a selection operation of the additional information display switching button B221 (FIG. 14) into the input unit 310. At this time, the data acquisition unit 225 hides the additional information display area W22. This allows the map to be displayed over a wider area (the map display area W21 becomes wider). When the supervisor inputs a selection operation of an additional information display switching button (not shown) into the input section 310, the additional information display area W22 may be displayed again by the data acquisition section 225.

FIG. 16 is a diagram showing an example when a selection operation of the additional information display switching button B221 is input. Here, it is assumed that the supervisor inputs a selection operation of the additional information display switching button B221 into the input unit 310. At this time, the additional information display area W22 is hidden by the data acquisition unit 224. This allows the map to be displayed over a wider area (the map display area W21 is wider). Note that, referring to FIG. 16, the detection screen G20 includes an additional information display switching button B223. When the supervisor inputs a selection operation of the additional information display switching button B223 into the input section 310, the additional information display area W22 may be displayed again by the data acquisition section 224.

Various display aspects related to the embodiments of the present invention have been described above. Although the display mode according to the embodiment of the present invention contributes to grasping information regarding detection, it may also be possible to save display contents so as to preserve information regarding detection. Specifically, when displaying the detection screen (FIGS. 11 to 16) on the supervisor terminal 30, part or all of the contents of the detection screen may be saved as an image or a PDF (Portable Document Format). In this case, the data providing unit 22 provides the supervisor terminal 30 with information regarding detection, including a display content preservation button related to saving the detection screen, and presses the display content preservation button while the detection screen is displayed on the supervisor terminal 30. is operated to save part or all of the contents of the detection screen as an image or PDF. In this way, the display content maintenance button can be placed on all or any of the detection screens (Figures 11 to 16) based on the supervisor's maintenance needs, so information related to detection can be adjusted according to the supervisor's needs. You will be able to plan for conservation.

[1-2. System operation]
Next, an example of the operation of the anti-poaching IoT system according to the embodiment of the present invention will be described. FIG. 17 is a flowchart illustrating an example of the operation of the anti-poaching IoT system according to the embodiment of the present invention. First, as shown in FIG. 17, the underwater acoustic sensor 10 obtains sensor data by sensing underwater. The underwater acoustic sensor 10 transmits sensor data to the server 20 (S11).

In the server 20, sensor data is received by the communication unit 240 (S21). The target object detection unit 222 attempts to detect a detection target based on sensor data. If the target object is not detected by the target object detection unit 222 ("NO" in S22), the operation proceeds to S11. On the other hand, when the detection target object is detected by the target object detection unit 222 (“YES” in S22), the detection notification unit 223 determines that the detection target object is a poaching boat or a poaching diver. If the map display URL is obtained (S23), the communication unit 240 is controlled so that a detection email containing the URL is sent to the supervisor terminal 30 (S24).

In the supervisor terminal 30, when the communication unit 340 receives the detection email (S31), the display unit 350 displays the detection email. If the monitor does not input a click operation on the URL included in the detected email into the input unit 310 ("NO" in S32), the operation moves to S11. On the other hand, if the monitor inputs a click operation on the URL included in the detection email into the input unit 310 (“YES” in S32), the control unit 320 sends a map display request to the server 20 as an example of a data transmission request. The communication unit 340 is controlled so that the information is transmitted to (S33).

In the server 20, when the map display request is received by the communication unit 240 (S25), the request acquisition unit 224 acquires the map display request. After acquiring the map (and additional information) corresponding to the URL, the data acquisition unit 225 controls the communication unit 240 so that the acquired map (and additional information) is transmitted to the supervisor terminal 30 (S26). In the supervisor terminal 30, when the map (and additional information) is received by the communication unit 340 (S34), the map (and additional information) is displayed on the display unit 350 (S35). S34 and S35 may be repeatedly executed at predetermined time intervals. As a result, the map (and additional information) displayed by the display unit 350 is updated at predetermined intervals.

The operation example of the anti-poaching IoT system according to the embodiment of the present invention has been described above.

[2. Hardware configuration example]
Next, an example of the hardware configuration of the server 20 according to the embodiment of the present invention will be described. However, the hardware configuration example of the supervisor terminal 30 according to the embodiment of the present invention can be similarly implemented.

An example of the hardware configuration of the information processing device 900 will be described below as an example of the hardware configuration of the server 20 according to the embodiment of the present invention. Note that the example hardware configuration of the information processing device 900 described below is only an example of the hardware configuration of the server 20. Therefore, for the hardware configuration of the server 20, unnecessary configurations may be deleted from the hardware configuration of the information processing apparatus 900 described below, or new configurations may be added.

FIG. 18 is a diagram showing a hardware configuration of an information processing device 900 as an example of the server 20 according to the embodiment of the present invention. The information processing device 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a host bus 904, a bridge 905, an external bus 906, and an interface. With 907 , an input device 908, an output device 909, a storage device 910, and a communication device 911.

The CPU 901 functions as an arithmetic processing device and a control device, and controls overall operations within the information processing device 900 according to various programs. Further, the CPU 901 may be a microprocessor. The ROM 902 stores programs used by the CPU 901, calculation parameters, and the like. The RAM 903 temporarily stores programs used in the execution of the CPU 901 and parameters that change as appropriate during the execution. These are interconnected by a host bus 904 composed of a CPU bus and the like.

The host bus 904 is connected via a bridge 905 to an external bus 906 such as a PCI (Peripheral Component Interconnect/Interface) bus. Note that the host bus 904, bridge 905, and external bus 906 do not necessarily need to be configured separately, and these functions may be implemented in one bus.

The input device 908 includes input means for the user to input information, such as a mouse, keyboard, touch panel, button, microphone, switch, and lever, and an input control circuit that generates an input signal based on the user's input and outputs it to the CPU 901. It is composed of etc. By operating the input device 908, a user operating the information processing device 900 can input various data to the information processing device 900 and instruct processing operations.

The output device 909 includes, for example, a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, a display device such as a lamp, and an audio output device such as a speaker.

The storage device 910 is a device for storing data. The storage device 910 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 910 is configured with, for example, an HDD (Hard Disk Drive). This storage device 910 drives a hard disk and stores programs executed by the CPU 901 and various data.

The communication device 911 is, for example, a communication interface configured with a communication device for connecting to a network. Further, the communication device 911 may support either wireless communication or wired communication.

The example hardware configuration of the server 20 according to the embodiment of the present invention has been described above.

[3. summary]
As described above, according to the embodiment of the present invention, based on the sensor data received from the sensor, the intensity of the sensor data is analyzed for each frequency of the sensor data and the time at which the sensor data is obtained. A server is provided that includes a control unit that obtains analysis results and controls the analysis results to be provided to a terminal. According to this configuration, it is possible to further improve convenience for a user who wants to recognize a detection target.

Although preferred embodiments of the present invention have been described above in detail with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person with ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea stated in the claims. It is understood that these also naturally fall within the technical scope of the present invention.

In the above, the word ``poaching'' was used to mean ``fishing in secret in violation of the law.'' Here, the word "poaching" should not be interpreted narrowly as meaning only the collection of seafood, but should be broadly interpreted as meaning living things other than seafood. For example, "poaching" can also include taking mammals that live in water (eg, dolphins, seals, etc.). In other words, the word "poaching" is generally used to mean taking mammals that live underwater, but "poaching" used in the embodiment of the present invention refers to taking mammals that live underwater. It does not exclude ``poaching,'' which refers to the taking of mammals.

[4. Other embodiments]
Embodiments of the present invention may also be used to detect smuggling, smuggling, illegal dumping (e.g., dumping of oil and waste, etc.), illegal acquisition of seabed resources (e.g., illegal acquisition of crude oil, natural gas, and methane hydrate, etc.), and piracy. applicable. Further, in the embodiment of the present invention, the server 20 can detect poaching based on the sensing result of a sensor different from the underwater acoustic sensor 12.

[4.1. Form applied to anti-smuggling]
For example, when the embodiment of the present invention is applied to anti-smuggling, the system according to the embodiment of the present invention becomes an "anti-smuggling IoT system." In this case, the objects to be detected are various objects used for smuggling, such as smuggling ships and smugglers, and smuggling can be monitored by the user. By treating smuggling ships and smugglers as objects to be detected, the "anti-smuggling IoT system" attempts to solve social issues and can be implemented more appropriately.

When the embodiments of the present invention are applied to anti-smuggling, the intensity of the sensor data is determined based on the sensor data received from sensors placed in areas where smugglers and smugglers may operate. It becomes possible to provide a server that includes a control unit that analyzes sensor data at each time of acquisition to obtain an analysis result, and controls the analysis result to be provided to a terminal. According to this configuration, it is possible to further improve user convenience.

[4.2. Form applied to counter-smuggling measures]
For example, when the embodiment of the present invention is applied to stowaway countermeasures, the system according to the embodiment of the present invention becomes a "stowaway countermeasure IoT system." In this case, the objects to be detected are various objects used for stowaways, such as stowaway ships and stowaways, and stowaways can be monitored by the user. By identifying stowaway ships and stowaways as objects to be detected, the "Anti-Stowaway IoT System" attempts to solve social issues and can be implemented more appropriately.

When the embodiment of the present invention is applied to stowaway countermeasures, the intensity of the sensor data is determined based on the sensor data received from sensors placed in areas where stowaway ships and stowaways may be active. It becomes possible to provide a server that includes a control unit that analyzes sensor data at each time of acquisition to obtain an analysis result, and controls the analysis result to be provided to a terminal. According to this configuration, it is possible to further improve user convenience.

[4.3. Form applied to prevent illegal dumping]
For example, when the embodiment of the present invention is applied to prevent illegal dumping, the system according to the embodiment of the present invention becomes an "Illegal dumping countermeasure IoT system." In this case, the objects to be detected are various objects used for illegal dumping, such as illegal dumping boats and illegal dumpers, and illegal dumping can be monitored by users. By identifying illegal dumping vessels and illegal dumpers as objects to be detected, the ``Illegal Dumping Countermeasure IoT System'' attempts to solve social issues and can be implemented more appropriately.

When the embodiment of the present invention is applied to illegal dumping measures, the intensity of the sensor data is determined based on sensor data received from sensors placed in areas where illegal dumping vessels and illegal dumpers may be active. It is possible to provide a server that includes a control unit that analyzes the frequency and the time at which the sensor data is obtained, obtains the analysis results, and controls the analysis results to be provided to the terminal. According to this configuration, it is possible to further improve user convenience.

[4.4. Form applied to measures against illegal acquisition of seabed resources]
For example, when the embodiment of the present invention is applied to countermeasures against illegal acquisition of seabed resources, the system according to the embodiment of the present invention becomes an "IoT system for countermeasures against illegal acquisition of seabed resources." In this case, the objects to be detected are various objects used for illegal acquisition of seabed resources, such as ships (such as drilling ships) and people who illegally acquire seabed resources, and the illegal acquisition of seabed resources is monitored by users. obtain. By identifying vessels that illegally acquire seabed resources and people who illegally acquire seabed resources as objects of detection, the "IoT system for countering illegal acquisition of seabed resources" will be an attempt to solve social issues and can be implemented more appropriately.

When the embodiment of the present invention is applied to countermeasures against illegal acquisition of seabed resources, based on sensor data received from sensors placed in areas where illegal seabed resource acquisition ships and seabed resource illegal acquirers may operate, the sensor data is It is possible to provide a server that includes a control unit that analyzes the intensity of the sensor data according to the frequency of the sensor data and the time at which the sensor data is obtained, obtains the analysis results, and controls the analysis results to be provided to the terminal. Become. According to this configuration, it is possible to further improve user convenience.

[4.5. Form applied to anti-piracy measures]
For example, when the embodiment of the present invention is applied to anti-piracy measures, the system according to the embodiments of the present invention becomes an "anti-piracy IoT system." In this case, the objects to be detected are various objects used in acts of piracy, such as pirate ships and pirates, and the acts of piracy can be monitored by the user. By treating pirate ships and pirates as objects to be detected, the "anti-piracy IoT system" attempts to solve social issues and can be implemented more appropriately.

When the embodiment of the present invention is applied to anti-piracy measures, the intensity of the sensor data is determined based on the frequency of the sensor data and the sensor data received from the sensors placed on the pirate ship and the area where pirates may be active. It is possible to provide a server that includes a control unit that performs analysis at each time when data is obtained, obtains analysis results, and controls the analysis results to be provided to a terminal. According to this configuration, it is possible to further improve user convenience.

[4.6. Form applied to preventive measures against terrorist acts]
For example, when the embodiment of the present invention is applied to countermeasures to prevent terrorist acts (for example, countermeasures to prevent terrorist acts to important coastal facilities (such as nuclear power plants)), the system according to the embodiment of the present invention is IoT system”. In this case, the managed object is a registered ship that patrols the coast, and based on the location information of the terminal installed on the regular ship and the position information of the object to be detected, the object to be detected is a suspicious ship or It can be determined whether the diver is a suspicious diver.

[4.7. Forms using other sensors]
In the embodiment of the present invention, the server 20 detects poaching based on the sensing results of the underwater acoustic sensor 12. Here, in the embodiment of the present invention, the server 20 may detect poaching based on the sensing result of a sensor different from the underwater acoustic sensor 12. In other words, the object to be detected may be detected based on information other than sound. In this case, as in the case where the underwater acoustic sensor 12 is used as a sensor, the object can be detected by detecting the characteristics of the object from the sensor data.

For example, the server 20 may detect poaching based on sensing results from an active sonar, radar, laser sensor, image sensor, or the like.

[4.7.1. Form that applies active sonar]
When the server 20 detects poaching based on the sensing result of an active sonar, the anti-poaching IoT system 1 includes an active sonar (not shown) and detects poaching based on the detection result of the active sonar. In this case, the active sonar has a sound wave transmitter that emits sound waves into the water, and a sound wave reflected wave receiver that receives the reflected sound from the detection target using multiple microphones, and sensor data (acoustic data) obtained by such sensing. , sound wave transmission time, sound wave reflected wave reception time) and sensor status information are transmitted to the server 20 by wireless communication. The server 20 detects the position and distance of the object to be detected from the time difference between the received radiated sound and the reflected sound and the detection direction of the reflected sound obtained from the acoustic data. Then, the server 20 uses the detection results to detect the detection target in the same manner as in the present embodiment described above. Note that in contrast to active sonar that emits sound waves underwater and captures the reflected sound from objects to be detected, this embodiment described above uses a sensor that detects objects (such as ships and divers) that exist underwater (including the water surface). It is a passive sonar that captures sound waves.

[4.7.2. Form where radar is applied]
When the server 20 detects poaching based on the radar sensing results, the anti-poaching IoT system 1 includes a radar (not shown) and detects poaching based on the radar detection results. In this case, the radar is installed so that it can be sensed (for example, installed on land such as the coast of the monitoring area), and radio waves such as millimeter waves or microwaves are transmitted within the detection range via the radar antenna. It has a radio wave transmitting section that transmits a search wave as a probe wave, and a radio wave reflected wave receiving section that receives a reflected wave from a detection target object. ) and sensor status information to the server 20 by wireless or wired communication. The server 20 detects the position and distance of the object to be detected from the time difference between the received exploration wave and the reflected wave and the detection direction of the reflected wave obtained from radar data. Then, the server 20 uses the detection results to detect the detection target in the same manner as in the present embodiment described above.

[4.7.3. Form using a laser sensor]
When the server 20 detects poaching based on the sensing results of a laser sensor (LRF (Laser rangefinder) or LIDAR (Light Detection and Ranging)), the anti-poaching IoT system 1 includes a laser sensor (not shown), Poaching is detected based on the detection results. In this case, the laser sensor is installed in a position where sensing is possible (for example, installed on land such as the coast of the monitoring area), and transmits laser light such as visible light, ultraviolet light, X-rays, and infrared light. It has a laser beam transmitter and a laser reflected light receiver that receives the reflected light from the detection target, and detects the detection data (laser data, laser beam transmission time, laser reflected light reception time) obtained by such sensing and the sensor state. The information is transmitted to the server 20 by wireless communication or wired communication. The server 20 detects the position and distance of the object to be detected based on the time difference between the received laser light and the laser reflected light and the moving direction of the laser reflected wave obtained from the laser data. Then, the server 20 uses the detection results to detect the detection target in the same manner as in the present embodiment described above.

[4.7.4. Form where image sensor is applied]
When the server 20 detects poaching based on the sensing result of an image sensor (hereinafter referred to as a camera), the anti-poaching IoT system 1 includes a camera (not shown) and detects poaching based on the detection result of the camera. In this case, the camera is installed at a position where sensing is possible (for example, installed on land such as the coast of the monitoring area), and the captured data (captured image) obtained through such sensing and sensor status information are transmitted wirelessly. The information is transmitted to the server 20 via communication or wired communication. The server 20 detects the detection target by pattern matching with pre-stored image information of the detection target. The server 20 may determine that the object is a poaching boat or a poacher if the object is detected from the image data received from the camera outside of operating hours. Note that the imaging data may be a moving image or a still image.

If the camera is a single camera, the server 20 stores a plurality of image information of a ship or a diver as a detection target at predetermined distances (for example, every 1 m) from the camera installation position and each distance information, which are associated in advance. is memorized. The server 20 detects the distance and position of the object to be detected using pattern matching or the like with respect to the captured image obtained from the camera. Further, the information stored in advance in the server 20 may be information on a plurality of images of distance markers that are imaged together with a ship or a diver that is a detection target.

In the case of multiple cameras, the server 20 processes the image of the object to be detected by making the optical axes of the multiple cameras (for example, the optical axes of two cameras) parallel, and superimposes the images of each to detect the object. The position may be determined by measuring the coordinates of the object to be detected using the principle of triangulation from the shift amount. Further, the server 20 detects the object to be detected by pattern matching the imaging data obtained from each of the plurality of cameras, calculates the center coordinates, and detects the coordinate position of the object to be detected by triangulation from the direction angle of each camera. The location may also be specified by

Furthermore, when capturing a moving image or a still image, the camera may capture the image in a first mode, a second mode, or a third mode. Here, the first mode may be general color photography. Further, the second mode may be infrared photography that is sensitive to infrared rays. Further, the third mode may be thermographic imaging that visualizes temperature distribution based on infrared rays. In this case, the camera determines which imaging means to apply, including a first imaging means corresponding to the first mode, a second imaging means corresponding to the second mode, and a third imaging means corresponding to the third mode. It has an imaging means switching means.

Specifically, when the first imaging means is applied when the camera is started, the imaging means switching means may switch the applied imaging means from the first imaging means to the second imaging means. Further, the imaging means switching means may perform switching control from a state where the first imaging means is applied alone to a state where the second imaging means and the third imaging means are applied simultaneously. Here, the imaging means switching means may control switching of the imaging means at predetermined intervals (for example, 10 seconds or 8 hours, etc.) or may control switching of the imaging means based on an instruction from an external device such as the server 20. It's okay. The instruction from the server 20 may be, for example, an instruction to switch the applied imaging means from the first imaging means to the second imaging means at 18:00 on March 31, 2020. Further, for example, a day/night detector (shading sensor) provided in an external device other than the server 20 may detect whether it is day or night based on the intensity of surrounding light, and may notify the server 20 of the detected information. In this case, the imaging means switching means of the camera may switch the applied imaging means from the first imaging means to the second imaging means based on the above-mentioned received detection information. Further, the imaging means switching means may perform switching control of the applied imaging means based on an analysis result related to image information of the detection target imaged by the camera. That is, the imaging means switching means can also control switching of the applied imaging means based on either the poaching vessel or the poaching person determined by image analysis. Note that the configuration of the camera may be changed as appropriate depending on the surrounding environment. Note that the camera is not limited to the first mode, second mode, and third mode described above, and may switch to other modes.

[4.7.5. Form where sensor switching is applied]
In addition to the underwater acoustic sensor 12 according to the present embodiment, the anti-poaching IoT system 1 may include the active sonar, radar, laser sensor, and image sensor exemplified above, and each sensor or server 20 may be It has a sensor switching means for deciding which sensor to apply, and the sensor switching means can switch the sensor to be applied among the underwater acoustic sensor 12, active sonar, radar, laser sensor, image sensor, etc. Specifically, when the underwater acoustic sensor 12 is applied when the sensor is activated, the sensor switching means may switch the applied sensor from the underwater acoustic sensor 12 to the image sensor. Further, the sensor switching means may perform switching control from a mode in which the underwater acoustic sensor 12 is applied alone to a mode in which the underwater acoustic sensor 12 and the image sensor are applied simultaneously. Here, the sensor switching means may control sensor switching at predetermined intervals (for example, 10 seconds or 8 hours, etc.) or may control sensor switching based on instructions from the server 20. The instruction from the server 20 may be, for example, an instruction to switch the applied sensor from the underwater acoustic sensor 12 to the image sensor at 9:00 on March 31, 2020.

As explained above, according to the embodiment in which other sensors are applied, it becomes possible to further improve the convenience for the user, and it is possible to suppress false detection as a detection target object.

1 Anti-poaching IoT system 10, 12 Underwater acoustic sensor 110 Antenna section 121 Searchlight 122 Berthing light section 123 Solar cell 130 Sensing section 140 Power supply section 150 Mooring section 160 Weight section 170 Transmission buoy section 181 Weight 182 Float 20 Server 220 Control section 22 1 Analysis section 222 Object detection section 223 Detection notification section 224 Request acquisition section 225 Data acquisition section 226 Data provision section 230 Storage section 231 Sensor information 232 Notification destination information 240 Communication section 30 Supervisor terminal 310 Input section 320 Control section 330 Storage section 340 Communication section 350 Display section

Claims (20)

Based on the sensor data received from the sensor, the intensity of the sensor data is analyzed for each frequency of the sensor data and the time at which the sensor data was obtained to obtain an analysis result, and the analysis result is provided to the terminal. comprising a control unit for controlling the
server. The control unit determines whether the intensity of the sensor data is greater than a first threshold value for each frequency and time based on the sensor data, and determines the result obtained by the determination as the analysis result. obtain,
The server according to claim 1. The control unit detects, based on the sensor data, a first frequency band in which the intensity of the sensor data is greater than the first threshold, and the first frequency band is wider than the first band. detecting a first detection target based on the
The server according to claim 2. The control unit detects, based on the sensor data, a first time at which there is a frequency where the intensity of the sensor data is greater than the first threshold, and detects a second time after a predetermined time from the first time. detecting as the first frequency band a frequency band in which the intensity of the sensor data at the time is greater than the first threshold;
The server according to claim 3. The control unit controls the terminal to provide identification information corresponding to information related to detection based on the detection of the first detection target.
The server according to claim 3 or 4. the first detection target is a ship;
The server according to any one of claims 3 to 5. The control unit detects a second detection target based on a model generated in advance by machine learning and the analysis result.
The server according to claim 1. The control unit detects the second detection target based on a detection probability of the second detection target output based on the model and the analysis result being greater than a predetermined probability. ,
The server according to claim 7. The control unit controls the terminal to provide identification information corresponding to information related to detection based on the detection of the second detection target.
The server according to claim 7 or 8. the second detection target is a diver;
The server according to any one of claims 7 to 9. The control unit detects a second frequency band in which the intensity of the sensor data is higher than a second threshold based on the sensor data, and detects a second frequency band based on the fact that the second frequency band is wider than the second band. canceling the detection of the second detection target;
The server according to any one of claims 7 to 10. The control unit detects a time when the intensity of the sensor data is greater than a second threshold based on the sensor data, and detects the second detection target based on the time being shorter than a predetermined time. cancel the detection of
The server according to any one of claims 7 to 10. The control unit controls to provide information related to the detection to the terminal based on receiving a transmission request based on the identification information from the terminal that has received the identification information.
The server according to claim 5 or 9. The information related to the detection includes a map according to the position of the sensor,
The server according to claim 13. The control unit controls to provide the analysis result to the terminal based on receiving a request to send the analysis result from the terminal.
The server according to any one of claims 1 to 14. The control unit transmits the analysis result and at least one of air pressure, water temperature, and wind power to the terminal, based on receiving a request to send the analysis result from the terminal. control to give to
The server according to claim 15. The sensor is an acoustic sensor,
the sensor data is sound obtained by the acoustic sensor;
A server according to any one of claims 1 to 16. The sensor data is detected by a sensor section included in the sensor,
The sensor unit is present in water.
A server according to any one of claims 1 to 17. Based on the sensor data received from the sensor, the intensity of the sensor data is analyzed for each frequency of the sensor data and the time at which the sensor data was obtained to obtain an analysis result, and the analysis result is provided to the terminal. including controlling
Processing method. to the computer,
Based on the sensor data received from the sensor, the intensity of the sensor data is analyzed for each frequency of the sensor data and the time at which the sensor data was obtained to obtain an analysis result, and the analysis result is provided to the terminal. A program for executing controlled things.

Images