JP2021153230A - Drone captured video providing system, program of drone captured video providing system, moving body captured video providing system, and program of moving body captured video providing system - Google Patents

Abstract

To provide a drone captured video providing system that allows a user to operate a drone in real time while viewing a display unit even when the current location of the user is far from the position of the drone.SOLUTION: A drone captured video providing system 100 includes drones 110 each having a camera 111 and standby at drone ports PT1 to PT3, a cloud server 120, and a user terminal 130. When the cloud server receives drone reservation period information from the user terminal, the cloud server sends, to the user terminal, an access code for allowing the drone to be freely operated within a reservation period. In a case where the access code is sent from the user terminal to the cloud server when the current date and time is within the reservation period, the cloud server receives captured data from the drone, sends the captured data to the user terminal, displays the captured data on a display unit 131, receives operation information from the user terminal, and sends the operation information to the drone.SELECTED DRAWING: Figure 1

Description

The present invention includes a drone having a camera, a cloud server, and a user terminal, and provides a drone shooting image providing system for providing shooting data by the drone to the user terminal, a program thereof, a moving body having a camera, a cloud server, and a user terminal. The present invention relates to a moving body shooting image providing system that provides shooting data by a moving body to a user terminal, and a program thereof.

Conventionally, an air vehicle that is remotely controlled by a worker using a transmitter as a radio control device is known (for example, Patent Document 1).
The camera provided on the flying object captures an image in the direction in which the lens faces and outputs it as image data.

JP-A-2019-219287 (see paragraph 0023, paragraph 0034 in particular).

However, each time the image data of the conventional flying object described above is output, it is sent to the transmitter owned by the worker who operates the flying object and the transmitter as a radio control device owned by the worker who operates the gimbal and the camera. Since it was configured to be sent, there was a problem that it was difficult to send a large amount of image data radio waves directly from the flying object to the transmitter when flying the flying object at a place far away from the user's current location.

Therefore, the present invention solves the problems of the prior art as described above, that is, the object of the present invention is a case where the user's current location is far from the position of the drone as a moving object. It is also to provide a drone shooting image providing system, its program, a moving body shooting image providing system, and its program, which allow the user to operate the drone in real time while looking at the display unit.

The invention according to claim 1 is a drone shooting video providing system provided with a drone having a camera, a cloud server, and a user terminal to provide shooting data by the drone to the user terminal, and the drone is attached to a drone port. It waits, and determines whether or not the cloud server has information on the usage status and reservation status of the drone, the drone port is selected by the user terminal, and the reservation period information is transmitted from the user terminal to the cloud server. When the reservation period information is transmitted, the cloud server sends an access code that allows the drone to be accessed and operated within the reservation period to the user terminal, and the user terminal accesses the cloud server to access the access code. Is transmitted and whether the current date and time is within the reservation period, and if both are satisfied, the cloud server permits the operation of the drone by the user terminal, and the user terminal and the user terminal It mediates communication with the drone and receives the shooting data taken by the drone and sends it to the user terminal, displays the shooting data on the display of the user terminal, and receives the operation information from the user terminal and sends it to the drone. The above-mentioned problems are solved by the configuration.

In the invention according to claim 2, in addition to the configuration of the drone shooting video providing system according to claim 1, the drone has a location information acquisition means, transmits the location information to a cloud server, and the cloud. The above-mentioned problems are solved by the configuration in which the server transmits at least one of the received drone position information and the direction information of the drone port calculated based on the position information to the user terminal and displays it on the display unit of the user terminal. It is a further solution.

In the invention according to the third aspect, in addition to the configuration of the drone shooting image providing system according to the first or second aspect, the drone has a position information acquisition means, and the position information is clouded together with the shooting data. It is transmitted to the server, the cloud server recognizes the shooting content using the image recognition means, records it in the database together with the location information and the date and time information, and when another user terminal accesses the cloud server, based on the database. The above-mentioned problems are further solved by the configuration in which the recognized biological information is displayed on the display unit of another user terminal together with the position information or the direction information and the date and time information based on the position information.

In the invention according to the fourth aspect, in addition to the configuration of the drone shooting image providing system according to any one of the first to third aspects, the drone provides a position information acquisition means and a direction information acquisition means. It has position information and direction information to be transmitted to a cloud server together with shooting data, and the cloud server has flight prohibited area information, and based on the received drone position information and direction information, flight prohibited area information is added to the shooting data. Is added and transmitted to the user terminal to be displayed on the display unit of the user terminal, thereby further solving the above-mentioned problems.

In the invention according to claim 5, in addition to the configuration of the drone shooting video providing system according to any one of claims 1 to 4, the cloud server is operating the current time based on the clock function. It is determined whether or not the reservation period of the drone has passed, and when the above period has passed, the operation of the drone by the user terminal is blocked, and the drone is moved to the drone port based on the position information by the position information acquisition means of the drone. By being there, the above-mentioned problems are further solved.

The invention according to claim 6 is a program of a drone shooting video providing system that includes a drone having a camera, a cloud server, and a user terminal and provides shooting data by the drone to the user terminal, and stands by at the drone port. Reservation application judgment to determine whether the drone port is selected by the user terminal and the reservation period information is sent from the user terminal to the cloud server based on the database of the cloud server that has the drone usage status and reservation status information. A step, an access code issuing step in which the cloud server accesses the drone within the reservation period and transmits an access code that allows the drone to be operated to the user terminal when the reservation period information is transmitted, and the user terminal If the cloud server satisfies both the user access determination step in which the cloud server determines whether or not the access code is transmitted by accessing the cloud server and whether or not the current date and time is within the reservation period, the cloud server determines whether or not the access code is transmitted. Allows the user terminal to operate the drone, mediates communication between the user terminal and the drone, receives the shooting data taken by the drone and sends it to the user terminal, and displays the shooting data on the display of the user terminal. It solves the above-mentioned problem by providing a user operation step of receiving operation information from the user terminal and transmitting it to the drone.

The invention according to claim 7 is a mobile body shooting image providing system provided with a moving body having a camera, a cloud server, and a user terminal, and providing shooting data by the moving body to the user terminal. , The cloud server has information on the usage status and reservation status of the mobile body, the mobile port is selected by the user terminal, and the reservation period information is transmitted from the user terminal to the cloud server. When it is determined whether or not the reservation period information is transmitted, the cloud server sends an access code capable of accessing the moving body and operating the moving body within the reservation period to the user terminal, and the user terminal. The cloud server determines whether or not the access code is transmitted by accessing the cloud server from, and whether or not the current date and time is within the reservation period, and if both are satisfied, the cloud server moves by the user terminal. Allows the operation of the body, mediates communication between the user terminal and the moving body, receives the shooting data taken by the moving body and sends it to the user terminal, displays the shooting data on the display part of the user terminal, and at the same time, the user The above-mentioned problems are solved by the configuration in which the operation information from the terminal is received and transmitted to the moving body.

The invention according to claim 8 is a program of a moving body shooting image providing system that includes a moving body having a camera, a cloud server, and a user terminal and provides shooting data by the moving body to the user terminal. Whether or not the mobile port is selected by the user terminal and the reservation period information is transmitted from the user terminal to the cloud server based on the database of the cloud server that has the usage status and reservation status information of the mobile body waiting at the port. When the reservation application determination step and the reservation period information are transmitted, the cloud server sends an access code to the user terminal that can access the mobile body and operate the mobile body within the reservation period. Satisfy both the issuing step and the user access determination step in which the cloud server determines whether or not the access code is transmitted by accessing the cloud server from the user terminal and whether or not the current date and time is within the reservation period. In this case, the cloud server permits the operation of the moving body by the user terminal, receives the shooting data taken by the moving body through communication between the user terminal and the moving body, and transmits the shooting data to the user terminal. Is displayed on the display unit of the user terminal, and the user operation step of receiving the operation information from the user terminal and transmitting the operation information to the moving body is provided to solve the above-mentioned problems.

Since the drone shooting video providing system of the present invention includes a drone having a camera, a cloud server, and a user terminal, the cloud server can not only communicate with the drone and the user terminal, but also as follows. Can produce unique effects.

According to the drone shooting video providing system of the invention according to claim 1, since the shooting data is displayed in real time on the display unit of the user terminal, the user can operate the drone in real time while looking at the display unit.
For example, if you select a drone port far away from the user's current location, the drone image of the selected drone port will be displayed in real time, so you can move far away without moving to the far away drone port location selected by the user. You can easily enjoy the feeling of traveling to this place, taking a walk in the air, or taking a walk in the water by freely looking around the remote places.

According to the drone shooting video providing system of the invention of claim 2, in addition to the effect of the invention of claim 1, at least one of the drone position information and the drone port direction information is displayed on the display unit of the user terminal. Since it is displayed in real time, the user can operate the drone while checking the location information of the drone or the direction information of the drone port.
Furthermore, if you operate the drone according to the direction information of the drone port, you will be guided to the drone port, so you can surely return the drone to the drone port.

According to the drone shooting video providing system of the invention according to claim 3, in addition to the effect of the invention according to claim 1 or 2, another user reserves the drone or operates the drone. Occasionally, biological information is displayed on the display, so other users can apply for and operate the drone in the hope that they will encounter the creature.

According to the drone shooting video providing system of the invention according to claim 4, in addition to the effect of the invention according to any one of claims 1 to 3, there is a no-fly zone near the flying drone. In this case, since the no-fly zone is displayed in the image displayed on the display unit of the user terminal, the user can operate the drone so as to avoid the no-fly zone, and trouble can be avoided.

According to the drone shooting video providing system of the invention according to claim 5, in addition to the effect of the invention according to any one of claims 1 to 4, the user automatically uses the drone when the rental period ends. Since the operation is completed and the drone returns to the drone port by autopilot, the user does not have to operate to return the drone to the drone port, and can enjoy it without worrying about the time for returning it.
Furthermore, since the drone returns to the drone port by the shortest route, the risk of unexpected delay in returning the drone can be avoided.

According to the program of the drone shooting video providing system of the invention of claim 6, the shooting data is displayed in real time on the display unit of the user terminal as in the effect of the invention of claim 1, so that the user can display the data. You can operate the drone in real time while looking at the department.
For example, if you select a drone port far away from the user's current location, the drone image of the selected drone port will be displayed in real time, so you can move far away without moving to the far away drone port location selected by the user. You can easily enjoy the feeling of traveling to this place, taking a walk in the air, or taking a walk in the water by freely looking around the remote places.

According to the mobile camera image providing system of the invention according to claim 7, the photographed data is displayed in real time on the display unit of the user terminal as in the effect of the invention according to claim 1, so that the user can display the display unit. You can operate the moving object in real time while watching.
For example, if you select a mobile port far away from the user's current location, the image of the mobile port of the selected mobile port will be displayed in real time, so you will move to the location of the mobile port far away selected by the user. You can easily enjoy the feeling of traveling, walking in the air, or taking a walk in the water by freely looking around a distant place without having to go around.

According to the program of the mobile camera image providing system according to the eighth aspect of the present invention, the photographed data is displayed in real time on the display unit of the user terminal in the same manner as the effect of the invention according to the first aspect, so that the user can use the user. You can operate the moving object in real time while looking at the display unit.
For example, if you select a mobile port far away from the user's current location, the image of the mobile port of the selected mobile port will be displayed in real time, so you will move to the location of the mobile port far away selected by the user. You can easily enjoy the feeling of traveling, walking in the air, or taking a walk in the water by freely looking around a distant place without having to go around.

The figure which shows the concept of the drone shooting image providing system which is an Example of this invention. The chart which shows the operation example of the drone shooting image providing system which is an Example of this invention. (A) and (B) are diagrams showing an example of an image taken by a drone. (A) and (B) are diagrams showing an example of an image taken by a drone. (A) and (B) are diagrams showing an example of an image taken by a drone.

The drone shooting video providing system of the present invention includes a drone having a camera, a cloud server, and a user terminal, the drone waits at the drone port, and the cloud server has information on the usage status and reservation status of the drone. , The drone port is selected by the user terminal, it is determined whether or not the reservation period information is transmitted from the user terminal to the cloud server, and when the reservation period information is transmitted, the cloud server accesses the drone within the reservation period. The access code that allows the drone to be operated is sent to the user terminal, and the cloud server determines whether the access code was sent by accessing the cloud server from the user terminal and whether the current date and time is within the reservation period. However, if both are satisfied, the cloud server permits the operation of the drone by the user terminal, receives the shooting data taken by the drone through the communication between the user terminal and the drone, and sends it to the user terminal, and the shooting data Is displayed on the display unit of the user terminal, and the operation information from the user terminal is received and transmitted to the drone, so that the user can operate the drone in real time while looking at the display unit. Easily enjoy the feeling of traveling, aerial walking, and underwater walking to this place by freely looking around the far away place without moving to the place of the drone port far away selected by the user. Any specific embodiment may be used as long as it can be used.
Further, in the program of the drone shooting video providing system of the present invention, the drone port is selected by the user terminal based on the database of the cloud server having the information of the usage status and the reservation status of the drone waiting in the drone port, and the reservation period. A reservation application determination step that determines whether or not the information has been sent from the user terminal to the cloud server, and when the reservation period information is transmitted, the cloud server accesses the drone within the reservation period and can freely operate the drone. A user who determines whether the access code issuance step of sending the code to the user terminal, whether the access code was sent by accessing the cloud server from the user terminal, and whether the current date and time is within the reservation period. If the access judgment step and both are satisfied, the cloud server permits the operation of the drone by the user terminal, mediates the communication between the user terminal and the drone, receives the shooting data taken by the drone, and sends it to the user terminal. , The shooting data is displayed on the display unit of the user terminal, and the user operation step of receiving the operation information from the user terminal and transmitting it to the drone is provided, so that the user can display the drone in real time while looking at the display unit. It can be operated with, for example, the feeling of traveling to this place by freely looking around the far away place without moving to the place of the drone port far away selected by the user, the feeling of walking in the air, etc. Any specific embodiment may be used as long as the feeling of walking in the water can be easily enjoyed.
Further, the moving body photographing image providing system of the present invention includes a moving body having a camera, a cloud server, and a user terminal, the moving body waits at the moving body port, and the cloud server is the moving body of the moving body. When it has information on usage status and reservation status, it is determined whether or not the mobile port is selected by the user terminal and the reservation period information is transmitted from the user terminal to the cloud server, and the reservation period information is transmitted. Whether or not the cloud server accesses the mobile body within the reservation period and sends an access code that allows the mobile body to be operated to the user terminal, and the user terminal accesses the cloud server and the access code is transmitted, and whether or not the access code is transmitted. , The cloud server determines whether the current date and time is within the reservation period, and if both are satisfied, the cloud server permits the operation of the mobile body by the user terminal and mediates communication between the user terminal and the mobile body. Then, the shooting data taken by the moving body is received and transmitted to the user terminal, the shooting data is displayed on the display unit of the user terminal, and the operation information from the user terminal is received and transmitted to the moving body. This allows the user to operate the moving object in real time while looking at the display, for example, freely looking at a distant place without moving to the location of the distant moving body port selected by the user. Any specific embodiment may be used as long as the feeling of traveling to this place, the feeling of walking in the air, or the feeling of walking in the water can be easily enjoyed.
Further, in the program of the moving body shooting image providing system of the present invention, the moving body port is selected by the user terminal based on the database of the cloud server having the information of the usage status and the reservation status of the moving body waiting in the moving body port. The reservation application determination step for determining whether or not the reservation period information has been transmitted from the user terminal to the cloud server, and when the reservation period information is transmitted, the cloud server accesses the moving object within the reservation period. The access code issuance step of sending an access code that allows the mobile body to be operated freely to the user terminal, whether or not the access code was sent by accessing the cloud server from the user terminal, and whether the current date and time is within the reservation period. If the user access determination step in which the cloud server determines whether or not the data is satisfied, and if both are satisfied, the cloud server permits the operation of the mobile body by the user terminal and mediates communication between the user terminal and the mobile body. It is provided with a user operation step of receiving the shooting data taken by the user terminal and transmitting the shooting data to the user terminal, displaying the shooting data on the display unit of the user terminal, and receiving the operation information from the user terminal and transmitting the operation information to the moving body. By doing so, the user can operate the moving object in real time while looking at the display unit. For example, the user can freely move to a distant place without moving to the place of the distant moving body port selected by the user. Any specific embodiment may be used as long as it is possible to easily enjoy the feeling of traveling to this place by looking around, the feeling of walking in the air, and the feeling of walking in the water.

For example, the user terminal displays shooting data on the screen of a browser of a display unit such as a desktop personal computer terminal, a notebook personal computer terminal, a smartphone terminal, a tablet terminal, a wristwatch type terminal, and a glasses type terminal. Any communication network including a wide area network, a local network, a telephone line, etc., which is the Internet, may be used as long as it connects to a cloud server and transmits / receives data.
Further, the operation by the user may be performed by the smartphone terminal or the tablet terminal itself as the user terminal, or may be performed by connecting a separate controller to the smartphone terminal or the tablet terminal.
Further, the cloud server is created in a cloud environment, and the number of physical servers constituting the cloud server may be one or a plurality.
Further, the moving body need only have a means of moving by power and can communicate with the cloud server, and has wheels that come into contact with the ground and moves along the ground, or has a propeller and is in the air. It can be anything, such as a drone that flies in the air, or a dive-capable drone that has a propeller and moves underwater.

Hereinafter, the drone shooting image providing system 100, which is a subconcept of the moving body shooting image providing system according to the embodiment of the present invention, will be described with reference to FIGS. 1 to 5 (B).
Here, FIG. 1 is a diagram showing the concept of the drone shooting video providing system 100 which is an embodiment of the present invention, and FIG. 2 shows an operation example of the drone shooting video providing system 100 which is an embodiment of the present invention. FIG. 3A is a chart diagram showing an example in which the image taken by the drone 110 and the direction information DR of the drone port PT1 are displayed on the display unit 131 of the user terminal 130, and FIG. 3B is a diagram. FIG. 4A is a diagram showing an example in which an image taken by the drone 110, biological information CT, direction information LC, and date / time information TM are displayed on the display unit 131 of the user terminal 130, and FIG. 4A is a diagram taken by the drone 110. FIG. 4 (B) is a diagram showing an example in which a whale is shown in the image taken, FIG. 4 (B) is a diagram showing an example in which a sea turtle is shown in an image taken by the drone 110, and FIG. 5 (A) is a diagram showing an example in which a sea turtle is shown. FIG. 5 (B) is a diagram showing an example in which an image taken by the drone 110 and a no-fly zone information AR are displayed on the display unit 131 of the user terminal 130, and FIG. 5 (B) shows the image taken by the drone 110 and the remaining time information. It is a figure which shows the example displayed on the display part 131 of a user terminal 130.

As shown in FIG. 1, the drone shooting image providing system 100, which is an embodiment of the present invention, includes a drone 110, which is an example of a mobile body, a cloud server 120, and a user terminal 130.
Of these, the drone 110 has a camera 111.
Further, the drone 110 stands by at drone ports PT1 to PT3 as mobile ports provided at tourist attractions all over the country and tourist attractions overseas as an example.
The drone shooting video providing system 100 is provided so as to provide shooting data by the drone 110 to the user terminal 130.
Specifically, the cloud server 120 has information on the usage status and reservation status of each drone 110.

Further, the drone port PT1 is selected by the user terminal 130, and the cloud server 120 determines whether or not the reservation period information is transmitted from the user terminal 130 to the cloud server 120.
When the reservation period information is transmitted, the cloud server 120 accesses the drone 110 within the reservation period and transmits an access code that allows the drone 110 to be operated to the user terminal 130.
Then, the cloud server 120 determines whether or not the access code is transmitted by accessing the cloud server 120 from the user terminal 130 and whether or not the current date and time is within the reservation period.

When both are satisfied, the cloud server 120 permits the operation of the drone 110 by the user terminal 130.
Then, the cloud server 120 mediates communication between the user terminal 130 and the drone 110, receives the shooting data taken by the drone 110, and transmits the shooting data to the user terminal 130.
Further, the cloud server 120 is configured to display the shooting data on the display unit 131 of the user terminal 130, receive the operation information from the user terminal 130, and transmit the operation information to the drone 110.
At this time, the shooting data is displayed on the display unit 131 of the user terminal 130 by using the so-called streaming technique.
For example, the user connects the operation unit 132, which is a so-called controller, to the user terminal 130, and transmits the operation information from the user terminal 130 to the cloud server 120.
The user may operate and input the user terminal 130 itself.

As a result, the shooting data is displayed in real time on the display unit 131 of the user terminal 130.
As a result, the user can operate the drone 110 in real time while looking at the display unit 131.
For example, when the drone port PT1 at a location far away from the user's current location is selected, the image of the drone 110 of the selected drone port PT1 is displayed in real time.
As a result, you can freely look around the distant place without moving to the place of the drone port PT1 which is far away selected by the user, and feel like traveling to this place, walking in the air or walking in the water. You can easily taste it.

For example, the user can enjoy watching the shooting data displayed on the display unit 131 by fitting the user terminal 130 into the goggles GL and attaching it to the head.
In the communication between the drone 110 and the cloud server 120 and the communication between the user terminal 130 and the cloud server 120, the cloud server 120 side transmits and receives radio waves using antennas such as base stations provided in various places. Of course.

Subsequently, the operation of the drone shooting video providing system 100 will be described in more detail.
As shown in FIG. 2, in step S1, as a reservation application determination step, the user terminal 130 is based on the database of the cloud server 120 having the usage status and reservation status information of the drones 110 waiting in the drone ports PT1 to PT3. The cloud server 120 determines whether or not the drone port PT1 is selected and the reservation period information is transmitted from the user terminal 130 to the cloud server 120.
In other words, it is determined whether or not the cloud server 120 has received, for example, the selection information of the drone port PT1 and the reservation period information from the user terminal 130.
If it is determined that the selection information and the reservation period information of the drone port PT1 have been received, the process proceeds to step S2, while if it is determined that the drone port PT1 has not been received, step S1 is repeated.

In step S2, as an access code issuing step, the cloud server 120 accesses the drone 110 within the reservation period and transmits an access code that allows the drone 110 to be operated to the user terminal 130.
In step S3, as a user access determination step, the cloud server 120 determines whether or not the access code is transmitted by accessing the cloud server 120 from the user terminal 130 and whether or not the current date and time is within the reservation period.

If it is determined that both are satisfied, the process proceeds to step S4, and if it is determined that at least one of the access code condition or the condition within the reservation period is not satisfied, step S3 is repeated.
If it is determined that the access code condition is not satisfied, an error may be displayed on the display unit 131 of the user terminal 130.
Further, if it is determined that the condition within the reservation period is not satisfied and it is before the reservation period, the display unit 131 of the user terminal 130 may display that it is before the reservation period.

In step S4, as a user operation step, the cloud server 120 permits the operation of the drone 110 by the user terminal 130.
Further, in step S5, as a user operation step, the cloud server 120 mediates communication between the user terminal 130 and the drone 110, receives the shooting data taken by the drone 110, transmits the shooting data to the user terminal 130, and transmits the shooting data. It is displayed on the display unit 131 of the user terminal 130.
At the same time, the operation information from the user terminal 130 is received and transmitted to the drone 110.

As a result, as shown in FIG. 3A, the shooting data is displayed in real time on the display unit 131 of the user terminal 130.
As a result, as described above, the user can operate the drone 110 in real time while looking at the display unit 131.
For example, when the drone port PT1 at a location far away from the user's current location is selected, the image of the drone 110 of the selected drone port PT1 is displayed in real time.
As a result, you can freely look around the distant place without moving to the place of the drone port PT1 which is far away selected by the user, and feel like traveling to this place, walking in the air or walking in the water. You can easily taste it.

Further, in this embodiment, the drone 110 has a position information acquisition means.
As a position information acquisition means, for example, a GPS (Global Positioning System) receiver provided in the drone 110 receives signals from three or more GPS satellites and acquires the current position information by the phase difference of the signals. It may be a thing.
Further, the current position information of the drone 110 may be acquired based on the received radio waves from at least eight of the plurality of GPS satellites, the plurality of quasi-zenith orbit satellites, and the geostationary orbit satellites.
Further, the current position information of the drone 110 may be acquired based on the radio wave received from the transmitter of the short-range wireless communication signal.

Then, the drone 110 transmits the location information to the cloud server 120.
Then, the cloud server 120 transmits at least one of the direction information DR of the drone port PT1 calculated based on the received position information of the drone 110 and the position information to the user terminal 130 and displays it on the display unit 131 of the user terminal 130. It is configured as follows.

As a result, as shown in FIG. 3A, the drone is displayed on the display unit 131 of the user terminal 130 as at least one of the position information of the drone 110 (for example, the position information display in the map format) and the direction information DR of the drone port PT1. The direction information DR of port PT1 is displayed in real time.
As a result, the user can operate the drone 110 while confirming the position information of the drone 110 or the direction information DR of the drone port PT1.
Further, when the drone 110 is operated according to the direction information DR of the drone port PT1, the drone port PT1 is guided.
As a result, the drone 110 can be reliably returned to the drone port PT1.

Further, in this embodiment, the drone 110 has a position information acquisition means and transmits the position information together with the shooting data to the cloud server 120.
Then, the cloud server 120 recognizes, for example, a living thing of the photographed content by using the image recognition means, and records it in the database together with the position information and the date and time information TM.
When the other user terminal 130 accesses the cloud server 120, the biological information CT recognized based on the database is displayed on the display unit 131 of the other user terminal 130 together with the location information or the direction information LC and the date and time information TM based on the location information. It is configured to be displayed in.
As a result, as shown in FIG. 3B, the biological information CT is displayed on the display unit 131 when another user reserves the drone 110 or operates the drone 110.
As a result, other users can apply for and operate the drone 110 in the hope of encountering the creature.

For example, as shown in FIG. 4A, it is assumed that the humpback whale is reflected in the shooting data taken by the camera 111 of the drone 110 operated by the user in advance.
This shooting data is transmitted from the drone 110 to the cloud server 120, and the cloud server 120 determines and recognizes that the creature shown by using the image recognition means is a "humpback whale".
The image recognition means recognizes the characteristic points (approximate size, shape / pattern / color of each part) of the reflected organism, and makes a determination by comparing it with the biological data in the database.
At this time, for example, there is a 80% chance that the creature in the picture is a "humpback whale", a 10% chance that it is a "sei whale", a 5% chance that it is a "Bryde's whale", and a 5% chance that it is "other". If it is determined that the whale is the most probable one, or the one satisfying the condition of the predetermined value of 70% or more, it is estimated to be a "humpback whale".

Then, the determined / recognized biological information is recorded in the database together with the received position information and date / time information TM.
After that, when it is determined that the drone 110 is located within a predetermined distance based on the position information recorded as the sighting information of the "Zatowhale" based on the position information of the drone 110, the user terminal 130 that operates the drone 110. The biological information CT is displayed on the display unit 131 together with the position information or the direction information LC and the date and time information TM based on the position information.
If the date and time information TM determines that the predetermined period has passed by comparing with the current date and time information, the possibility of witnessing again is reduced, so that the date and time information TM may not be displayed.

Further, as shown in FIG. 4B, it is assumed that the green turtle is reflected in the shooting data taken by the camera 111 of the underwater drone (110) operated by the user in advance.
This shooting data is transmitted from the underwater drone (110) to the cloud server 120, and the cloud server 120 determines and recognizes that the organism shown by using the image recognition means is a "green turtle".
At this time, for example, the creature in the picture has a 80% chance of being a "green turtle", a 10% chance of being a "hawksbill turtle", a 5% chance of being a "loggerhead turtle", and a 5% chance of being "other". When it is determined, it is presumed that it is a "green turtle" that satisfies the condition of the one with the highest possibility or the predetermined value of 70% or more.

Then, the determined / recognized biological information is recorded in the database together with the received position information and date / time information TM.
After that, when it is determined that the underwater drone (110) is located within a predetermined distance based on the position information recorded as the sighting information of the "green turtle" based on the position information of the underwater drone (110), the underwater drone (110) is determined to be located. The biological information CT is displayed on the display unit 131 of the user terminal 130 that operates the underwater drone (110) together with the position information or the direction information LC and the date and time information TM based on the position information.

As described above, the underwater organisms that are highly likely to be visible even from the air are displayed on the display unit 131 of the user terminal 130 of the user who is operating the drone 110 for flight.
On the other hand, underwater creatures that are unlikely to be visible from the air are not displayed on the display unit 131 of the user terminal 130 of the user who is operating the flight drone 110, but the underwater drone (110) is operated. It is displayed only on the display unit 131 of the user terminal 130 of the user.
Although the example of recognizing the photographed organism has been described, the photographed plant may be recognized.
Then, at the time of application, biological information and plant information may be searchably displayed on the website in association with drone ports PT1 to PT3.

Further, in this embodiment, the drone 110 has a position information acquisition means and a direction information acquisition means.
Then, the drone 110 transmits the position information and the orientation information to the cloud server 120 together with the shooting data.
Further, the cloud server 120 has a no-fly zone information AR.
Then, the cloud server 120 adds the flight prohibited area information AR to the shooting data based on the received position information and orientation information of the drone 110, transmits it to the user terminal 130, and displays it on the display unit 131 of the user terminal 130. It is configured in.

As a result, as shown in FIG. 5A, when there is a no-fly zone near the flying drone 110, the no-fly zone information AR is displayed on the image displayed on the display unit 131 of the user terminal 130.
For example, when it is determined that the drone 110 is located within a predetermined distance with respect to the no-fly zone and is heading for the no-fly zone based on the position information of the drone 110, the no-fly zone information AR is displayed. ..
As a result, the user can operate the drone 110 so as to avoid the no-fly zone, and trouble can be avoided.
At this time, the cloud server 120 spatially analyzes the shooting data received from the drone 110, applies the area shape of the flight prohibited area information AR held in advance to the space of the shooting data, and prohibits flight on the display unit 131. It may be configured to display the area information AR.
As a result, the area shape of the no-fly zone information AR is displayed with high accuracy.
As a result, the user can operate the drone 110 more reliably to avoid the no-fly zone.

Further, in this embodiment, the cloud server 120 determines whether or not the remaining available time is shorter than the predetermined time based on the reservation period information of the drone 110 and the current date and time information.
Then, when it is determined that the remaining available time is shorter than the predetermined time, the cloud server 120 is configured to display the information of the remaining available time on the display unit 131 of the user terminal 130.
As a result, as shown in FIG. 5B, information on the remaining available time is displayed on the display unit 131 of the user terminal 130.
As a result, the user can operate the drone 110 in consideration of the remaining available time, and can fly the drone 110 to the drone port PT1 and return it.

The cloud server 120 may be configured to determine whether or not the current time has passed the reservation period of the drone 110 being operated based on the clock function.
Then, when it is determined that the time has passed, the operation of the drone 110 by the user terminal 130 may be blocked, and the drone 110 may be moved to the drone port PT1 based on the position information by the position information acquisition means of the drone 110.
As a result, when the rental period ends, the operation by the user is automatically completed, and the drone 110 returns to the drone port PT1 by autopilot.
As a result, the user does not need to operate to return the drone 110 to the drone port PT1, and can enjoy it without worrying about the time for returning the drone 110.
Furthermore, the drone 110 returns to the drone port PT1 by the shortest route.
As a result, the risk of unexpected return delay of the drone 110 can be avoided.
In this embodiment, the drone 110 is moved by flight, but it may be moved underwater.
In this embodiment, the drone 110 has been described as an example of the moving body, but the moving body may have wheels and move along the ground.

The drone shooting video providing system 100, which is an embodiment of the moving body shooting video providing system of the present invention thus obtained, includes a drone 110 having a camera 111, a cloud server 120, and a user terminal 130, and the drone 110 However, the cloud server 120 has information on the usage status and reservation status of the drone 110, the drone port PT1 is selected by the user terminal 130, and the reservation period information is clouded from the user terminal 130. It is determined whether or not the data has been transmitted to the server 120, and when the reservation period information is transmitted, the cloud server 120 accesses the drone 110 within the reservation period and transmits an access code that allows the drone 110 to be operated to the user terminal 130. Then, the cloud server 120 determines whether or not the access code is transmitted by accessing the cloud server 120 from the user terminal 130 and whether or not the current date and time is within the reservation period, and if both are satisfied, the cloud server 120 Allows the operation of the drone 110 by the user terminal 130, mediates communication between the user terminal 130 and the drone 110, receives the shooting data taken by the drone 110, transmits the shooting data to the user terminal 130, and transmits the shooting data to the user terminal. The user can operate the drone 110 in real time while looking at the display unit 131 by displaying the operation information on the display unit 131 of the 130 and receiving the operation information from the user terminal 130 and transmitting the operation information to the drone 110. For example, without having to move to the location of the drone port PT1 that is far away selected by the user, you can freely look around the remote location and feel like traveling to this location, feeling like an aerial walk, or feeling like an underwater walk. You can easily taste it.

Further, the drone 110 has a location information acquisition means, transmits the location information to the cloud server 120, and the cloud server 120 calculates the location information of the drone 110 and the direction information of the drone port PT1 calculated based on the location information. By transmitting at least one of the DRs to the user terminal 130 and displaying it on the display unit 131 of the user terminal 130, the user can check the position information of the drone 110 or the direction information DR of the drone port PT1 while checking the drone 110. It can be operated and the drone 110 can be reliably returned to the drone port PT1.

Further, the drone 110 has a position information acquisition means, transmits the position information together with the shooting data to the cloud server 120, and the cloud server 120 recognizes the shooting content by using the image recognition means, and the position information and the date and time information TM. When another user terminal 130 accesses the cloud server 120, the biological information CT recognized based on the database is recorded in the database together with the location information or the direction information LC and the date and time information TM based on the location information. By displaying the information on the display unit 131 of the terminal 130, other users can apply for and operate the drone 110 in anticipation of encountering a living thing.

Further, the drone 110 has a position information acquisition means and a direction information acquisition means, transmits the position information and the direction information together with the shooting data to the cloud server 120, and the cloud server 120 has the flight prohibited area information AR and receives the information. Based on the position information and orientation information of the drone 110, the flight prohibited area information AR is added to the shooting data and transmitted to the user terminal 130 to be displayed on the display unit 131 of the user terminal 130, so that the user can fly. The drone 110 can be operated so as to avoid the prohibited area, and troubles can be avoided.

Further, the cloud server 120 determines whether or not the reservation period of the drone 110 being operated has passed the current time based on the clock function, and when it has passed, the operation of the drone 110 by the user terminal 130 is blocked, and the drone 110 is operated. Since the drone 110 is moved to the drone port PT1 based on the position information obtained by the position information acquisition means of the above, the user does not need to perform an operation for returning the drone 110 to the drone port PT1. You can enjoy it without worrying about the time, and you can avoid the risk of unexpected return delay of the drone 110.

Further, the program of the drone shooting video providing system 100, which is an embodiment of the program of the moving body shooting video providing system of the present invention, is a cloud having information on the usage status and reservation status of the drones 110 waiting at the drone ports PT1 to PT3. Based on the database of the server 120, the drone port PT1 is selected by the user terminal 130, and the reservation application determination step S1 for determining whether or not the reservation period information is transmitted from the user terminal 130 to the cloud server 120 and the reservation period information are When the data is transmitted, the cloud server 120 accesses the drone 110 within the reservation period and transmits an access code that allows the drone 110 to be operated to the user terminal 130. The access code issuance step S2 and the user terminal 130 to the cloud server 120. If the cloud server 120 satisfies both the user access determination step S3 in which the cloud server 120 determines whether or not the access code has been transmitted and whether or not the current date and time is within the reservation period, the cloud server 120 is the user terminal. The operation of the drone 110 by the 130 is permitted, the shooting data taken by the drone 110 is received and transmitted to the user terminal 130 through the communication between the user terminal 130 and the drone 110, and the shooting data is transmitted to the display unit of the user terminal 130. By providing the user operation steps S4 and S5 for displaying on the 131 and receiving the operation information from the user terminal 130 and transmitting the operation information to the drone 110, the user can see the drone 110 in real time while looking at the display unit 131. It can be operated, for example, the feeling of traveling to this place by freely looking around the far away place without moving to the place of the drone port PT1 far away selected by the user, the feeling of walking in the air, etc. The effect is enormous, such as being able to easily enjoy the feeling of an underwater walk.

100 ・ ・ ・ Drone shooting video providing system (mobile shooting video providing system)
110 ・ ・ ・ Drone (mobile body)
111 ・ ・ ・ Camera 120 ・ ・ ・ Cloud server 130 ・ ・ ・ User terminal 131 ・ ・ ・ Display unit 132 ・ ・ ・ Operation unit (controller)
PT1 ・ ・ ・ (1st) Drone port (mobile port)
PT2 ・ ・ ・ (2nd) Drone port (mobile port)
PT3 ・ ・ ・ (3rd) Drone port (mobile port)
GL ・ ・ ・ Goggles DR ・ ・ ・ Direction information CT ・ ・ ・ (Recognized organism) Biological information LC ・ ・ ・ (Recognized organism) Direction information TM ・ ・ ・ (Recognized) Date and time information of living things AR ・ ・ ・ Information on prohibited areas

Claims (8)

It is a drone shooting video providing system that provides a drone with a camera, a cloud server, and a user terminal to provide shooting data by the drone to the user terminal.
The drone waits at the drone port and
The cloud server has information on the usage status and reservation status of the drone, determines whether or not the drone port is selected by the user terminal and the reservation period information is transmitted from the user terminal to the cloud server.
When the reservation period information is transmitted, the cloud server sends an access code that allows the drone to be accessed and operated within the reservation period to the user terminal.
The cloud server determines whether or not the access code is transmitted by accessing the cloud server from the user terminal and whether or not the current date and time is within the reservation period.
When both are satisfied, the cloud server permits the operation of the drone by the user terminal, receives the shooting data taken by the drone through communication between the user terminal and the drone, and transmits the shooting data to the user terminal. Is displayed on the display unit of the user terminal, and the operation information from the user terminal is received and transmitted to the drone. The drone has a location information acquisition means, transmits the location information to the cloud server, and
The cloud server is characterized in that it transmits at least one of the received drone position information and the direction information of the drone port calculated based on the position information to the user terminal and displays it on the display unit of the user terminal. The drone shooting video providing system according to claim 1. The drone has a location information acquisition means and transmits the location information together with the shooting data to the cloud server.
The cloud server recognizes the shooting content using an image recognition means and records it in a database together with location information and date and time information, and when another user terminal accesses the cloud server, biological information recognized based on the database. The drone shooting image providing system according to claim 1 or 2, wherein is configured to display the position information or the direction information based on the position information and the date and time information on the display unit of another user terminal. The drone has a location information acquisition means and a orientation information acquisition means, and transmits the location information and the orientation information together with shooting data to a cloud server.
The cloud server has flight prohibited area information, adds flight prohibited area information to shooting data based on received drone position information and orientation information, transmits it to the user terminal, and displays it on the display unit of the user terminal. The drone shooting image providing system according to any one of claims 1 to 3, characterized in that it has a configuration. The cloud server determines whether or not the current time has passed the reservation period of the drone being operated based on the clock function, and when the time has passed, blocks the operation of the drone by the user terminal and means for acquiring the position information of the drone. The drone shooting image providing system according to any one of claims 1 to 4, wherein the drone is moved to the drone port based on the position information according to the above. It is a program of a drone shooting video providing system that provides a drone with a camera, a cloud server, and a user terminal to provide shooting data by the drone to the user terminal.
Whether or not the drone port is selected by the user terminal and the reservation period information is sent from the user terminal to the cloud server based on the database of the cloud server that has the information on the usage status and reservation status of the drone waiting at the drone port. Reservation application judgment step to judge and
When the reservation period information is transmitted, the cloud server sends an access code that allows the drone to access the drone and operate the drone within the reservation period to the user terminal, and an access code issuance step.
A user access determination step in which the cloud server determines whether or not the access code is transmitted by accessing the cloud server from the user terminal and whether or not the current date and time is within the reservation period.
When both are satisfied, the cloud server permits the operation of the drone by the user terminal, receives the shooting data taken by the drone through communication between the user terminal and the drone, and transmits the shooting data to the user terminal. Is displayed on the display unit of the user terminal, and is provided with a user operation step of receiving operation information from the user terminal and transmitting the operation information to the drone. It is a mobile body shooting video providing system that provides a moving body with a camera, a cloud server, and a user terminal to provide shooting data by the moving body to the user terminal.
The mover waits at the mover port and
The cloud server has information on the usage status and reservation status of the mobile body, determines whether or not the mobile port is selected by the user terminal and the reservation period information is transmitted from the user terminal to the cloud server.
When the reservation period information is transmitted, the cloud server sends an access code to the user terminal that can access the mobile body and operate the mobile body within the reservation period.
The cloud server determines whether or not the access code is transmitted by accessing the cloud server from the user terminal and whether or not the current date and time is within the reservation period.
When both are satisfied, the cloud server permits the operation of the mobile body by the user terminal, receives the shooting data taken by the mobile body through communication between the user terminal and the mobile body, and transmits the shooting data to the user terminal. , A mobile shooting video providing system characterized in that the shooting data is displayed on the display unit of the user terminal, and the operation information from the user terminal is received and transmitted to the moving body. It is a program of a moving body shooting video providing system that provides a moving body with a camera, a cloud server, and a user terminal to provide shooting data by the moving body to the user terminal.
Whether the mobile port was selected by the user terminal and the reservation period information was sent from the user terminal to the cloud server based on the database of the cloud server that has the information on the usage status and reservation status of the mobile that waits at the mobile port. Reservation application judgment step to judge whether or not,
When the reservation period information is transmitted, the cloud server sends an access code to the user terminal that can access the mobile body and operate the mobile body within the reservation period, and an access code issuing step.
A user access determination step in which the cloud server determines whether or not the access code is transmitted by accessing the cloud server from the user terminal and whether or not the current date and time is within the reservation period.
When both are satisfied, the cloud server permits the operation of the mobile body by the user terminal, receives the shooting data taken by the mobile body through communication between the user terminal and the mobile body, and transmits the shooting data to the user terminal. , A mobile body shooting image providing system characterized in that the shooting data is displayed on the display unit of the user terminal and the user operation step of receiving the operation information from the user terminal and transmitting the operation information to the moving body is provided. program.

Images