WO2019146551A1

WO2019146551A1 - Information processing device

Info

Publication number: WO2019146551A1
Application number: PCT/JP2019/001696
Authority: WO
Inventors: 中川　宏; 山田　和宏; 陽平大野; 雄一朗瀬川
Original assignee: 株式会社Ｎｔｔドコモ
Priority date: 2018-01-26
Filing date: 2019-01-21
Publication date: 2019-08-01
Also published as: JPWO2019146551A1; JP6957651B2

Abstract

The present invention addresses the problem of knowing the required time which is necessary for processing when performing processing at the accuracy required by a flying object. A server device (20) is one example of an information processing device according to the present invention, and the server device (20) performs processing for calculating the normalized difference vegetation index (NDVI) from the spectral reflectance properties of vegetation by using the imaging results from a flying object (10). In addition, the server device (20) performs processing for calculating the required time which is necessary for processing when performing processing at the accuracy required by the flying object (10).

Description

Information processing device

The present invention relates to a technique for estimating the time required for processing using a flying object.

For example, Patent Document 1 generates a map in which a plurality of cells are arranged in a work area, calculates the area S of the work area based on the map, and calculates the required work time from the calculated area S. Is described.

JP, 2017-176115, A

For example, in the case where a flying object images a plant in a field and calculates a normalized vegetation index (NDVI: Normalized Difference Vegetation Index) from spectral reflectance characteristics of the plant, the speed or altitude of the flying object flying above the field, etc. Accordingly, the calculation accuracy of the NDVI is different. For example, the higher the flight speed of the aircraft, the worse the accuracy of the calculated NDVI. Also, for example, the higher the flight altitude of the aircraft, the worse the accuracy of the calculated NDVI.

In view of such background, it is an object of the present invention to know the required time required for processing when the processing is performed with the accuracy required for a flying object.

In order to solve the above problems, according to the present invention, there is provided a specification unit for specifying a target accuracy, which is a target value of accuracy in processing performed by a flying object on a processing target area, and a size of the processing target area; An information processing apparatus comprising: a calculation unit for calculating a required time required for the flight body to perform the process with the target accuracy specified for the processing target area having a different size. .

The processing is processing performed based on imaging of the ground by the aircraft, and the calculation unit may calculate the required time based on the size of the range covered by one imaging. Good.

The calculation unit may change the size of the effective range in the captured image according to the condition.

The calculation unit may change the size of the effective range in accordance with the amount of light at the time of imaging or imaging timing.

The calculation unit may correct the required time according to the light amount at the time of imaging or the imaging time.

When the required time calculated by the calculation unit exceeds the upper limit of the target required time, generation is performed to generate information on the size of the processing target area that can perform the process with the upper limit A unit may be provided.

The calculation unit may compare the lower limit of the required time according to the execution of the calibration for the process with the target required time, and generate information according to the comparison result.

According to the present invention, when processing is performed with the accuracy required for a flying object, the required time required for the processing can be known.

1 shows an example of the configuration of a flight control system 1. FIG. FIG. 2 is a view showing an example of the appearance of a flying object 10; It is a figure which shows the hardware constitutions of the flying body 10. As shown in FIG. FIG. 2 is a diagram showing a hardware configuration of a server device 20. FIG. 2 is a diagram showing an example of a functional configuration of a server device 20. It is a figure which illustrates the effective range of a captured image. It is a figure explaining the meaning of the functions f and g. 6 is a flowchart illustrating an example of a required time calculation operation of the server device 20.

Configuration FIG. 1 is a diagram showing an example of the configuration of a flight control system 1. The flight control system 1 is a system that controls the flight of the flying object 10. The flight control system 1 includes a plurality of aircraft 10 and a server device 20. The airframe 10 and the server device 20 can communicate with each other via a network. For example, the flying object 10 performs a process of imaging a plant in the field on a processing target area such as a field. The server apparatus 20 is an example of the information processing apparatus according to the present invention, and the normalized vegetation index (NDVI: Normalized Difference Vegetation Index) is calculated from the spectral reflection characteristics of plants in the processing target area using the imaging results of the flying object 10. Perform processing to calculate. In addition, when performing processing with the accuracy required for the flying object 10, the server device 20 performs processing for calculating the required time required for the processing.

FIG. 2 is a view showing an example of the appearance of the flying object 10. The flying object 10 is, for example, a so-called drone, and includes a propeller 101, a drive device 102, and a battery 103.

The propeller 101 rotates about an axis. As the propeller 101 rotates, the flying object 10 flies. The driving device 102 powers and rotates the propeller 101. The drive device 102 includes, for example, a motor and a transmission mechanism that transmits the power of the motor to the propeller 101. The battery 103 supplies power to each part of the aircraft 10 including the drive device 102.

FIG. 3 is a diagram showing the hardware configuration of the aircraft 10. The flying object 10 is physically configured as a computer device including a processor 11, a memory 12, a storage 13, a communication device 14, a positioning device 15, an imaging device 16, a beacon device 17, a bus 18, and the like. In the following description, the term "device" can be read as a circuit, a device, a unit, or the like.

The processor 11 operates an operating system, for example, to control the entire computer. The processor 11 may be configured by a central processing unit (CPU) including an interface with a peripheral device, a control device, an arithmetic device, a register, and the like.

Further, the processor 11 reads a program (program code), a software module or data from the storage 13 and / or the communication device 14 to the memory 12 and executes various processing according to these. As a program, a program that causes a computer to execute at least a part of the operation of the flying object 10 is used. The various processes performed in the aircraft 10 may be performed by one processor 11 or may be performed simultaneously or sequentially by two or more processors 11. The processor 11 may be implemented by one or more chips. The program may be transmitted from the network via a telecommunication line.

The memory 12 is a computer readable recording medium, and includes, for example, at least one of a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and a RAM (Random Access Memory). It may be done. The memory 12 may be called a register, a cache, a main memory (main storage device) or the like. The memory 12 can store a program (program code), a software module, and the like that can be executed to implement the flight control method according to the embodiment of the present invention.

The storage 13 is a computer readable recording medium, and is, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magnetooptical disk (for example, a compact disk, a digital versatile disk, Blu-ray A (registered trademark) disk, a smart card, a flash memory (for example, a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, and the like may be used. The storage 13 may be called an auxiliary storage device.

The communication device 14 is hardware (transmission / reception device) for performing communication between computers via a wired and / or wireless network, and is also called, for example, a network device, a network controller, a network card, a communication module, or the like.

The positioning device 15 measures the three-dimensional position of the aircraft 10. The positioning device 15 is, for example, a GPS (Global Positioning System) receiver, and measures the current position of the aircraft 10 based on GPS signals received from a plurality of satellites.

The imaging device 16 captures an image around the flying object 10. The imaging device 16 is, for example, a camera, and captures an image by forming an image on an imaging element using an optical system. The imaging device 16 captures an image of a predetermined range, for example, below the flying object 10.

The beacon device 17 transmits a beacon signal of a predetermined frequency, and also receives a beacon signal transmitted from another flying object 10. The reach of this beacon signal is a predetermined distance such as 100 m. The beacon signal includes aircraft identification information that identifies the aircraft 10 that transmits the beacon signal. This flying body identification information is used to prevent collision of the flying bodies 10 with each other.

The devices such as the processor 11 and the memory 12 described above are connected by a bus 18 for communicating information. The bus 18 may be configured as a single bus or may be configured as different buses among the devices.

FIG. 4 is a diagram showing a hardware configuration of the server device 20. As shown in FIG. The server device 20 is physically configured as a computer device including a processor 21, a memory 22, a storage 23, a communication device 24, a bus 25 and the like. The processor 21, the memory 22, the storage 23, the communication device 24, and the bus 25 are similar to the processor 11, the memory 12, the storage 13, the communication device 14, and the bus 18 described above, and thus the description thereof is omitted.

FIG. 5 is a diagram showing an example of a functional configuration of the server device 20. As shown in FIG. Each function in the server device 20 causes the processor 21 to perform an operation by reading predetermined software (program) on hardware such as the processor 21 and the memory 22, thereby performing communication by the communication device 24, the memory 22, and the storage 23. This is realized by controlling the reading and / or writing of data in

In FIG. 5, the tracking unit 200 records the flying object identification information of the flying object 10 under control of the server device 20 and the flight status thereof. The flight status includes the position where the flying object 10 is flying and the date and time at that position. The tracking unit 200 records position information and date and time information notified from the aircraft 10. In addition, the tracking unit 200 determines whether the position information and the date and time information are within a previously planned flight plan, and records the determination result.

The input unit 201 inputs, to the server device 20, the target accuracy for the processing performed on the field which is the processing target area by the flying object 10 and the size of the processing target area. The target accuracy here is, for example, a value predetermined as the accuracy of the NDVI. Further, the input unit 201 inputs image data indicating an image captured by the flying object 10 to the server device 20.

The identifying unit 202 identifies, based on the information input by the input unit 201, the target accuracy in the process performed on the processing target area by the aircraft 10 and the size of the processing target area.

The calculating unit 203 calculates the time required for the flight object 10 to perform imaging processing so that the target accuracy specified by the specifying unit 202 can be realized with respect to the processing target area of the size specified by the specifying unit 202. Do. This process is a process performed based on the imaging of the ground (field) by the aircraft 10, and the calculation unit 203 calculates the required time based on the size of the effective range in the imaged image. In addition, the calculation unit 203 changes the size of the effective range according to the condition. More specifically, the calculation unit 203 determines the size of the effective range using the condition of the light amount at the time of imaging. The larger the amount of light at the time of imaging, the larger the effective range, and the smaller the amount of light at the time of imaging, the smaller the effective range.

Here, the effective range in the captured image will be described. FIG. 6 is a diagram for explaining this effective range. For one imaging range P, a part thereof becomes the effective range Pu. In general, the lens used when the flying object 10 captures an image for NDVI calculation is a fisheye lens. The image captured by this fisheye lens is a two-dimensional circular image, and NDVI is calculated from the spectral reflectance characteristics of plants in this image. Since the calculation result of the NDVI varies depending on the elevation angle at the time of imaging, in particular, the calculation result at the edge of the captured image changes significantly. Therefore, in the captured image, it is preferable to set a circular area of a predetermined range from the center of the imaging range as an effective range, and set the effective range as a calculation target of NDVI. Also, the effective range varies depending on the flight altitude of the flying object 10. That is, when the flight altitude is high, the imaging range P in one imaging becomes wide, and as a result, the effective range Pu also widens. On the other hand, when the flight altitude is low, the imaging range P in one imaging also becomes narrow, and as a result, the effective range Pu also becomes narrow.

Thus, the calculation unit 203 calculates the required time based on the size of the range covered by one imaging. When calculating the NDVI of the field which is the processing target area, it is desirable to calculate the NDVI from the spectral reflectance characteristics of the plant in the range of a predetermined ratio (for example 10%) of the size of the whole area. When the effective range in the image is different, the number of imaging processes is also different. Specifically, when the effective range in the captured image is large (larger than a certain value), the number of imaging processes decreases, and the effective range in the captured image is small (smaller than a certain value) In this case, the number of imaging processes also increases.

When the required time calculated by the calculation unit 203 exceeds the upper limit of the target required time, the generation unit 204 is information on the size of the processing target area that can be processed with the upper limit For example, the ratio of the size of the processing target area that can be processed at the above upper limit to the size of the entire processing target area is generated. Thus, when the entire range of the processing target area can not be processed within the target required time, the degree of processing completion in the entire processing target area can be estimated.

The evaluation value calculation unit 206 calculates NDVI from the spectral reflection characteristics of the plants in the image based on the image data input by the input unit 201.

The output unit 205 outputs the required time calculated by the calculation unit 203, the information generated by the generation unit 204, or the NDVI calculated by the evaluation value calculation unit 206.

Operation Next, the operation of this embodiment will be described. In the following description, when the flying object 10 is described as a subject of processing, specifically, the processor 11 is read by reading predetermined software (program) on hardware such as the processor 11 and the memory 12. Means that the process is executed by performing an operation and controlling communication by the communication device 14 and reading and / or writing of data in the memory 12 and the storage 13. The same applies to the server device 20.

FIG. 8 is a flowchart showing an example of the required time calculation operation of the server device 20. First, the input unit 201 inputs, to the server device 20, the target accuracy for the process performed on the field which is the processing target area by the flying object 10 and the size of the processing target area (step S11). This input may be performed by an input device connected to the server device 20 or may be performed by a remote control device of the aircraft 10.

The identifying unit 202 identifies, based on the information input by the input unit 201, the target accuracy for the process performed by the flying object 10 on the processing target area and the size of the processing target area (step S12).

The calculation unit 203 calculates the required time required for the flying object 10 to perform the imaging process as described below so as to achieve the specified target accuracy for the specified size of the processing target area (see below) Step S13).

The accuracy A is expressed by a function f of the flying height h of the flying object 10, as shown in the following equation.
A = f (h)

When the flying object 10 captures an image of the processing target area, the higher the flight altitude, the more reflected light from a wide ground area other than the area directly below the flying object 10 has effects. Therefore, this function f is designed to be a function such that the accuracy A becomes lower as the flight height h of the flying object 10 becomes higher.

The required time T is expressed by a function g of the flying height h and the flying speed v of the flying object 10, as shown in the following equation.
T = g (h, v)

Here, since the imaging is performed with the flying object 10 stopped, the flight speed v is a velocity at which the flying object 10 moves between the respective imaging positions. The function g may include the area and shape of the processing target area (field), the effective range Pu, the photographing stop time (time to temporarily stop at the time of photographing), the number of times of photographing, etc. as variables.

Here, the significance of the functions f and g will be described. First, the flying height h is determined from the precision A by the function f. Next, based on the flying height h and the effective range Pu, an imaging range to be covered by the flying object 10 in one imaging is determined. Then, a flight plan including various flight conditions is determined based on the one imaging range and the size of the processing target area. The flight plan determines the time required for the aircraft 10 to process T. Therefore, as shown in FIG. 7, the required time T becomes long when imaging processing is performed such that the flight altitude is low and the flight path to the processing target area is dense. On the other hand, when the flight altitude is high and the flight path to the processing target area has a low density (that is, the processing range per unit section is wide), the required time T becomes short.

If the required time T calculated by the calculation unit 203 exceeds the upper limit of the target required time (step S14; NO), the generation unit 204 can process the area with the upper limit. The information on the size of is generated (step S15). Specifically, when the size S1 of the processing target area that can be processed at the upper limit, the size S of the processing target area, and the upper limit Tt of the target required time is represented as follows.
Size Sl = (Tt / T) × S

The generation unit 204 generates (Sl / S) × 100 (%) as information on the size of the processing target area that can be processed at the upper limit.

The output unit 205 outputs the required time T calculated by the calculation unit 203 or information ((Sl / S) × 100 (%)) generated by the generation unit 204 (step S16).

According to the above embodiment, when performing processing with the accuracy required for the flying object 10, it is possible to know the required time required for the processing.

Modifications The present invention is not limited to the embodiments described above. You may deform | transform the embodiment mentioned above as follows. Also, the following two or more modifications may be implemented in combination.
Modification 1
For example, since the sun height differs according to the imaging time such as morning / afternoon, time zone or month or season, and as a result the light amount at the time of imaging differs, the calculation unit 203 corrects the required time according to the imaging time You may Specifically, since the correction equation based on the light amount L at the time of imaging can be expressed by the function e (t) at time t, the required time T is corrected with a formula called required time T × e (t). In addition, the calculation unit 203 may correct the required time according to the light amount itself at the time of imaging. Specifically, the required time T is corrected with a formula called required time T × d (L) using the function d (L) related to the light amount L at the time of imaging.

Modification 2
The calculation unit 203 may compare the lower limit of the required time according to the execution of the calibration for the process with the target required time, and generate information according to the comparison result. This makes it possible to determine whether the processing can be completed within the target time when calibration is performed. Specifically, before the imaging process, for example, an object of a predetermined color such as a white board is imaged to perform calibration of the imaging apparatus. By this calibration, the lower limit of the time required for the aircraft 10 to perform processing at a certain flight speed and flight altitude with a predetermined target accuracy can be determined. The calculation unit 203 compares the lower limit of the required time according to the execution of the calibration for the process with the target required time, and generates information (for example, the ratio of the former to the latter) according to the comparison result.

Modification 3
As described above, since the amount of light at the time of imaging and the imaging timing have a certain relationship, the calculation unit 203 may change the effective range Pu in accordance with the imaging timing.

Modification 4
In the present invention, the process performed by the flying object is not limited to the imaging process of a field or the like. Further, each equation described above is merely an example, and addition of a constant or a coefficient to the equation described above is optional.

Other Modifications The block diagram used in the description of the above embodiment shows blocks in units of functions. These functional blocks (components) are realized by any combination of hardware and / or software. Moreover, the implementation means of each functional block is not particularly limited. That is, each functional block may be realized by one physically and / or logically coupled device, or directly and / or indirectly two or more physically and / or logically separated devices. It may be connected by (for example, wired and / or wireless) and realized by the plurality of devices.
In addition, at least a part of the functions of the server device 20 may be implemented on the aircraft 10. Similarly, at least part of the functions of the aircraft 10 may be implemented on the server device 20.

Each aspect / embodiment described in the present specification is LTE (Long Term Evolution), LTE-A (LTE-Advanced), SUPER 3G, IMT-Advanced, 4G, 5G, FRA (Future Radio Access), W-CDMA (Registered trademark), GSM (registered trademark), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi), IEEE 802.16 (WiMAX), IEEE 802.20, UWB (Ultra-Wide Band), The present invention may be applied to a system utilizing Bluetooth (registered trademark), other appropriate systems, and / or an advanced next-generation system based on these.

As long as there is no contradiction, the processing procedure, sequence, flow chart, etc. of each aspect / embodiment described in this specification may be reversed. For example, for the methods described herein, elements of the various steps are presented in an exemplary order and are not limited to the particular order presented.
Each aspect / embodiment described in this specification may be used alone, may be used in combination, and may be switched and used along with execution. In addition, notification of predetermined information (for example, notification of "it is X") is not limited to what is explicitly performed, but is performed by implicit (for example, not notifying of the predetermined information) It is also good.

The terms "system" and "network" as used herein are used interchangeably.

The information or parameters described in the present specification may be represented by absolute values, may be represented by relative values from predetermined values, or may be represented by corresponding other information. For example, radio resources may be indexed.

The names used for the parameters described above are in no way limiting. In addition, the formulas etc. that use these parameters may differ from those explicitly disclosed herein. Since various channels (eg PUCCH, PDCCH etc.) and information elements (eg TPC etc.) can be identified by any suitable names, the various names assigned to these various channels and information elements can be Is not limited.

The terms "determining", "determining" as used herein may encompass a wide variety of operations. For example, “judgment” and “decision” may be judging, calculating, calculating, processing, processing, deriving, investigating, looking up (for example, a table) (Searching in a database or another data structure), ascertaining may be considered as “decision” or “decision”. Also, "determination" and "determination" are receiving (for example, receiving information), transmitting (for example, transmitting information), input (input), output (output), access (Accessing) (for example, accessing data in a memory) may be regarded as "determined" or "determined". In addition, "determination" and "decision" are to be considered as "determination" and "determination" that they have resolved (resolving), selecting (selecting), choosing (choosing), establishing (establishing), etc. May be included. That is, "determination" "determination" may include considering that some action is "determination" "determination".

The present invention may be provided as a flight control method or an information processing method including the steps of processing performed in the flight control system 1 or the server device 20. Also, the present invention may be provided as a program executed on the airframe 10 or the server device 20. Such a program may be provided in the form of being recorded in a recording medium such as an optical disk, or may be provided in the form of being downloaded to a computer via a network such as the Internet and installed and made available. It is possible.

Software, instructions, etc. may be sent and received via a transmission medium. For example, software may use a wireline technology such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL) and / or a website, server or other using wireless technology such as infrared, radio and microwave When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission medium.

The information, signals, etc. described herein may be represented using any of a variety of different techniques. For example, data, instructions, commands, information, signals, bits, symbols, chips etc that may be mentioned throughout the above description may be voltage, current, electromagnetic waves, magnetic fields or particles, optical fields or photons, or any of these May be represented by a combination of

The terms described herein and / or the terms necessary for the understanding of the present specification may be replaced with terms having the same or similar meanings. For example, the channels and / or symbols may be signals. Also, the signal may be a message. Also, the component carrier (CC) may be called a carrier frequency, a cell or the like.

Any reference to an element using the designation "first," "second," etc. as used herein does not generally limit the quantity or order of those elements. These designations may be used herein as a convenient way of distinguishing between two or more elements. Thus, reference to the first and second elements does not mean that only two elements can be taken there, or that in any way the first element must precede the second element.

The “means” in the configuration of each device described above may be replaced with a “unit”, a “circuit”, a “device” or the like.

Insofar as "including", "comprising" and variations thereof are used in the present specification or claims, these terms as well as the term "comprising" are inclusive. Intended to be Further, it is intended that the term "or" as used in the present specification or in the claims is not an exclusive OR.

Throughout the disclosure, for example, when articles are added by translation, such as a, an, and the in English, these articles are not clearly indicated by the context, unless the article clearly indicates otherwise. It shall contain several things.

Although the present invention has been described above in detail, it is apparent to those skilled in the art that the present invention is not limited to the embodiments described herein. The present invention can be embodied as modifications and alterations without departing from the spirit and scope of the present invention defined by the description of the claims. Accordingly, the description in the present specification is for the purpose of illustration and does not have any limiting meaning on the present invention.

1: Flight control system 10: Flight object 20: Server device 21: Processor 22: Memory 23: Storage 24: Communication device 25: Bus 200: Tracking unit 201: Input unit 202: Identification Part, 203: Calculation part, 204: Generation part, 205: Output part, 206: Evaluation value calculation part.

Claims

A target accuracy that is a target value of accuracy in processing performed by the flight object on the processing target area, and a specifying unit that specifies the size of the processing target area;
An information processing apparatus comprising: a calculation unit that calculates a required time required for the flight body to perform the process with the target accuracy specified for the processing target area of the specified size .
The processing is processing performed based on imaging of the ground by the aircraft,
The information processing apparatus according to claim 1, wherein the calculation unit calculates the required time based on a size of a range covered by one imaging.
The information processing apparatus according to claim 2, wherein the calculation unit changes the size of the effective range in the captured image according to a condition.
The information processing apparatus according to claim 3, wherein the calculation unit changes the size of the effective range in accordance with a light amount at the time of imaging or an imaging time.
The information processing apparatus according to claim 2, wherein the calculation unit corrects the required time according to a light quantity at the time of imaging or an imaging time.
When the required time calculated by the calculation unit exceeds the upper limit of the target required time, generation is performed to generate information on the size of the processing target area that can perform the process with the upper limit The information processing apparatus according to any one of claims 1 to 5, further comprising:
The calculation unit compares the lower limit of the required time according to the execution of the calibration for the process with the target required time, and generates information according to the comparison result. The information processing apparatus according to any one of 6.