KR20230040851A - method of performing land control based on drone operation through an application - Google Patents

Abstract

Embodiments of the present invention relate to a method of performing pest control on a land using a drone, and a system thereof. Embodiments of the present invention relate to a method of performing pest control on a land based on a drone operation through an application. Embodiments of the present invention relate to an application server for providing a drone pest control service to a work client who has requested the pest control using the drone, and the operation method thereof.

Description

How to perform land control based on drone operation through an application {method of performing land control based on drone operation through an application}

Embodiments of the present invention relate to a method and system for performing land control using a drone.

Embodiments of the present invention relate to a method of performing land control based on drone operation through an application.

Embodiments of the present invention relate to an application server and an operating method for providing a drone control service to a job requester who has requested a control operation using a drone.

Drones, which refer to unmanned aerial vehicles developed for military use in the early 20th century, have recently been used for commercial purposes by multinational companies such as Germany's DHL, America's Amazon, and Google, and the size of the related market is also rapidly expanding. Over the next 10 years, the size of the drone industry is expected to expand more than 20 times compared to the present, and the market size of domestic drone manufacturing is estimated to be 415.8 billion won in 2022, and the operation and service utilization field is estimated to be 1214.2 billion won in 2022.

On the other hand, various automation technologies are being developed to improve productivity in the agricultural field and solve the labor shortage of domestic farms. In particular, drones can be used for control of agricultural areas as they can minimize pesticide damage to pesticides during control of agricultural and forestry fields. Agricultural land control using drones is optimized for spraying eco-friendly chemicals and has excellent economic feasibility compared to existing technologies, so demand is increasing significantly.

Currently, the maximum size that can be controlled by one drone operator per day is about 60,000 pyeong, and in the case of drone control, it is often performed jointly by several drone control operators. Accordingly, in addition to the drone control operator, additional personnel for progress and management are required to proceed with the control operation. In addition, most of the drone control companies are operating on a small scale, so there are cases where contracts with work clients are not properly fulfilled. For example, a business disruption caused by a pest control operator performing drone control or a problem with receivables from a work client is representative.

Accordingly, there is a need for a solution system that integrates and provides everything from the assignment of drone control operators to farmland, reporting on control work progress and results, payment for drone control service usage, and user evaluation collection.

(001) Korean Patent Publication No. 10-2019-0076181 (2019.07.02) (002) Korean Patent Publication No. 10-2020-0080447 (2020.07.07)

Embodiments of the present disclosure may provide a method of operating a server providing an application related to land control using drones.

Technical tasks to be achieved in the embodiments are not limited to those mentioned above, and other technical tasks not mentioned will be considered by those skilled in the art from various embodiments to be described below. can

According to embodiments, in a method of operating a server providing an application related to land control using drones, receiving a request for a drone control operation from a task client; Acquiring spatial information on land for which drone control work is requested; Dividing the land into a plurality of work zones in which control work is performed based on the received spatial information; Matching a drone control operator for each of a plurality of divided work areas among a plurality of drone control operators registered in the application; Generating control completion data for a control operation performed by a matched drone control operator; And it provides a method comprising the step of transmitting the generated control completion data to the terminal of the work client. At this time, the drone control service provided through the application includes a plurality of different service types according to the quality of the control service, and the number of a plurality of work areas divided from the land determines the drone control service for the land among the plurality of service types. It may be determined according to the type of service selected for

According to embodiments, the request for drone control operation includes service type information indicating one selected for drone control service for land from among a plurality of service types, and the method comprises: per control area based on the service type information. determining a service unit price; Generating payment information for the drone control service for the land based on the service unit price per control area; and providing a payment interface including the generated payment information to the job requester.

According to embodiments, the step of matching the drone control operators may include generating a plurality of control operator groups including at least some of the plurality of drone control officers according to the control efficiency score intervals of each of the plurality of drone control officers; Selecting any one of a plurality of control company groups based on the service type information; and allocating a drone control operator for each of a plurality of divided work areas from among drone control operators belonging to the selected control operator group. In this case, the higher the service unit price per control area determined according to the service type information, the higher the control efficiency score of each drone control operator belonging to the selected group.

According to embodiments, a method may include generating advertising information related to a drone based on location information of land; and exposing advertisement information to the matched drone control operator while the matched drone control operator is performing a control operation on the land. At this time, the lower the service unit price per control area determined according to the service type information, the larger the advertisement information may be displayed on the terminal of the drone control operator.

According to embodiments, the advertisement information includes first advertisement information for a seller selling parts related to a control drone and second advertisement information for a drone repair company located within a predetermined range based on land location information. can include At this time, the step of exposing the advertisement information includes the step of displaying each of the first advertisement information and the second advertisement information periodically alternately, and the control efficiency score of the matched drone control company is the control efficiency score of the plurality of drone control companies. When lower than or equal to the average, the second time period during which the second advertisement information is exposed to the application may be longer than the first time during which the first advertisement information is exposed to the application.

According to embodiments, in a server providing an application related to land control using drones, a memory for storing instructions for operation of the application server; processor; And a communication unit for transmitting and receiving information necessary to provide the application, and the processor receives a request for drone control work from a work client through the communication unit according to an instruction stored in a memory, and receives a request for a drone control operation for the land for which the drone control operation is requested. Acquiring spatial information, dividing the land into a plurality of work areas where control work is performed based on the received spatial information, and a drone control operator for each of a plurality of divided work areas among a plurality of drone control companies registered in the application , and control completion data for the control operation performed by the matched drone operator may be generated, and the generated control completion data may be transmitted to the terminal of the job requester. At this time, the drone control service provided through the application includes a plurality of different service types according to the quality of the control service, and the number of a plurality of work areas divided from the land determines the drone control service for the land among the plurality of service types. It may be determined according to the type of service selected for

According to embodiments, the application server and its operating method may control service procedures so that drone control services are smoothly provided to work clients. The application server and its operating method may provide options for various types of service to a job client who wants to receive a drone control service for land.

According to embodiments, the application server and its operation method can shorten the period for completing the control work for the entire land by allocating different drone control operators for each of a plurality of divided work areas.

According to the embodiments, location-based advertisement information may be provided while the application server and operation drone control operation are performed, so that rapid response is possible in an accident situation such as damage or loss of a drone.

Effects obtainable from the embodiments are not limited to the effects mentioned above, and other effects not mentioned are clearly derived and understood by those skilled in the art based on the detailed description below. It can be.

BRIEF DESCRIPTION OF THE DRAWINGS Included as part of the detailed description to aid understanding of the embodiments, the accompanying drawings provide various embodiments and, together with the detailed description, describe technical features of the various embodiments.
1 is a schematic diagram showing a drone control service providing system for providing a land control service using drones according to an embodiment of the present invention.
2 is a flowchart illustrating a method of operating an application server according to an exemplary embodiment.
3 is a diagram illustrating an example of a job client interface provided by an application server.
4 is a diagram for explaining an example of a plurality of work zones divided from land according to an embodiment of the present invention.
5 is a diagram illustrating a screen provided by an application server to a drone control operator while a drone control operation is in progress according to an embodiment of the present invention.
6 is a block diagram showing the configuration of an application server according to an embodiment.

The following embodiments combine elements and features of the embodiments in a predetermined form. Each component or feature may be considered optional unless explicitly stated otherwise. Each component or feature may be implemented in a form not combined with other components or features. In addition, various embodiments may be configured by combining some components and/or features. The order of operations described in various embodiments may be changed. Some components or features of one embodiment may be included in another embodiment, or may be replaced with corresponding components or features of another embodiment.

In the description of the drawings, procedures or steps that may obscure the gist of various embodiments are not described, and procedures or steps that can be understood by those skilled in the art are not described. did

Throughout the specification, when a part is said to "comprising" or "including" a certain element, it means that it may further include other elements, not excluding other elements, unless otherwise stated. do. In addition, terms such as “… unit”, “… unit”, and “module” described in the specification mean a unit that processes at least one function or operation, which is hardware or software or a combination of hardware and software. can be implemented as Also, “a or an”, “one”, “the” and like terms are used herein in the context of describing various embodiments (particularly in the context of the claims below). Unless otherwise indicated or clearly contradicted by context, both the singular and the plural can be used.

The present disclosure relates to an application server that provides a farmland control service using a drone through a mobile terminal and an operating method thereof. The application server according to various embodiments of the present disclosure may provide options for various service types to a job client who wants to receive a drone control service for land. For example, the application server may provide a plurality of service types at different prices according to the quality of the control service, and may provide a drone control service according to the service type selected by the work client. Through this, the application server can increase the convenience and satisfaction of the job requester and the drone control operator who want to receive the drone control service for the land.

In addition, in the present disclosure, work clients may include farmers, mountain owners, local agricultural cooperatives, local governments, local forest management offices, and regional agricultural technology centers.

Hereinafter, embodiments according to various embodiments will be described in detail with reference to the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The detailed description set forth below in conjunction with the accompanying drawings is intended to describe exemplary embodiments of various embodiments, and is not intended to represent a single embodiment.

In addition, specific terms used in various embodiments are provided to help understanding of various embodiments, and the use of these specific terms may be changed into other forms without departing from the technical spirit of various embodiments. .

1 is a schematic diagram showing a drone control service providing system 10 that provides a land control service using drones according to an embodiment of the present invention.

Referring to FIG. 1 , the drone control service providing system 10 may include an application server 100, a job client terminal 200, a drone control operator terminal 300, and a drone control company server 400.

The application server 100 according to embodiments of the present disclosure may provide a drone control service for land according to a request for a drone control operation from a work client. For example, the application server 100 may receive a drone control request of a task client from the task client terminal 200 . In the present disclosure, land may include arable land and forests such as farmland, fields, and forests. Land may include multiple parcels. In the present disclosure, the work client terminal 200 may be a terminal of a work client who wants to receive a drone control service for land.

The job client terminal 200 may generate a drone control operation request of the job client by receiving information about the location of the land where the drone control service is to be provided, the control period, and the type of service. For example, the work client terminal 200 may perform touch input, touch and drag input, and mouse click on the control request information input screen provided by the application server 100. You can get input, or click and drag input. The job client terminal 200 may obtain text and/or numeric input for the control request information input screen provided by the application server 100 . The task client terminal 200 may transmit the generated drone control task request to the application server 100 .

In an embodiment of the present disclosure, the job client terminal 200 may include all types of devices including a function of displaying a video screen and a user input interface. For example, the job client terminal 200 may include a smart phone, a tablet PC, a PC, a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a micro server, a global positioning system (GPS) device, and an e-book reader. , digital broadcast terminals, navigations, kiosks, MP3 players, digital cameras, consumer electronics and other mobile or non-mobile computing devices. In addition, the job client terminal 200 may include a wearable device such as a watch, glasses, hair band, and ring having a display function and a user input interface.

The application server 100 according to embodiments of the present disclosure may assign a plurality of drone control operators to the land where the drone control operation is requested so that the control operation is performed. For example, the application server 100 may divide the land into a plurality of work areas and allocate a drone control operator for each work area. The application server 100 may transmit the assigned work area to the drone control company terminal 300 or the drone control company server 400 .

In the present disclosure, the drone control operator terminal 300 may be a terminal used by a drone control operator who uses a drone to control land. The drone control operator terminal 300 may receive information about the assigned work area from the application server 100 . Information on the assigned work area may include land location information and spatial information. The drone control operator terminal 300 may be used to control the drone for control while controlling the land for which the drone control operation is requested.

In an embodiment of the present disclosure, the drone control operator terminal 300 may include all types of devices including a function of displaying a video screen and a user input interface. For example, the drone control operator terminal 300 is a smart phone, a tablet PC, a PC, a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a micro server, a global positioning system (GPS) device, and an e-book. It may include terminals, digital broadcasting terminals, navigations, kiosks, MP3 players, digital cameras, consumer electronics and other mobile or non-mobile computing devices. In addition, the drone control operator terminal 300 may include a wearable device such as a watch, glasses, hair band, and ring having a display function and a user input interface.

The application server 100 according to embodiments of the present disclosure may provide a report on control operations performed by a plurality of drone control operators to a job requester. For example, the application server 100 may generate control completion data for control operations performed by a plurality of drone control operators. Next, the application server 100 may transmit the generated control completion data to the job requester terminal (200).

According to an embodiment, when a drone control service is provided through a drone control company, the above-described control completion data may be generated through the drone control company server 400. In the present disclosure, the drone control company server 400 may be a server device of a company that provides a drone control service using an application provided by the application server 100 .

Additionally, the application server 100 may receive evaluation information on the control work performed from the job requester terminal 200 . The application server 100 may provide the evaluation information input screen to the job client through the job client terminal 200 . The job client terminal 200 may generate evaluation information by obtaining text and/or numeric input for an evaluation information input screen provided by the application server 100 . The job requester terminal 200 may transmit the generated evaluation information to the application server 100 . The application server 100 may transmit the received evaluation information to the drone control company terminal 300 or the drone control company server 400 .

As shown in FIG. 1, components of the drone control service providing system 10 may be connected through a network 500. According to an embodiment, a network refers to a connection structure capable of exchanging information between nodes such as a plurality of terminals and servers, and examples of such networks include RF, 3rd Generation Partnership Project (3GPP) network, LTE ( Long Term Evolution (5GPP) network, 5GPP (5rd Generation Partnership Project) network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area) Network), PAN (Personal Area Network), Bluetooth (Bluetooth) network, NFC network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network, etc. are included, but are not limited thereto.

Hereinafter, a method for providing an application related to land control using a drone by an application server according to an embodiment of the present invention will be described.

2 is a flowchart illustrating a method of operating an application server according to an exemplary embodiment.

Referring to FIG. 2 , in step S201, the application server may receive a request for a drone control task from a task client. The request for the drone control operation may include at least one of location information, land size information, and lot number information of the land subject to control using drones. According to an embodiment, the application server may receive a request for drone control work from a terminal of a work client. The job client can create a drone control request for the land through a job request interface provided by the application server. The application server may receive the generated drone control request from the job client terminal using the input interface of the job client terminal.

According to an embodiment, the request for the drone control operation may include service type information indicating one selected for the requested land from among a plurality of service types provided through the application. The drone control service provided through the application may include a plurality of different service types according to the quality of the control service. For example, the service type information may indicate any one of a high-end type, a low-end type, and a low-end type.

The application server may provide a service type selection interface through which a work client may select a service type in relation to land control work. The work sponsor may select a service type for the land through the service type selection interface. The application server may determine the service type for the land based on the work client's input information received from the work client's terminal.

In step S202, the application server may acquire spatial information about the land for which the drone control operation is requested. The application server may obtain spatial information on the land based on the request for the drone control operation received in step S201. Spatial information about the land may include at least one of a satellite image corresponding to the land, a road view, and a flat designation point. For example, the application server may obtain a cadastral map managed by a national geographic information management agency based on land location information or lot number information. At this time, the national geographic information management institution may be the Ministry of Land, Infrastructure and Transport. The application server may acquire spatial information about land through a land and forest information inquiry service of a geographic information management institution. For example, the application server may receive at least one of a satellite image, a road view, and a flat cadastral map corresponding to land.

In step S203, the application server may divide the land into a plurality of work zones based on spatial information. The application server may divide the land using the spatial information obtained in step S202. According to one embodiment, land may include one or more parcels. In this case, the application server may separate a plurality of work areas by dividing the land by lot.

According to one embodiment, the number of the plurality of work zones subdivided from the land may be determined according to the type of service for the land. The application server may determine the number of work zones to be subdivided from the land based on the service type information for the land. The application server may divide the land into a determined number of work zones. In this regard, it will be described in detail through FIG. 4 to be described later.

According to one embodiment, the application server may divide the land using a pre-learned division learning model. The split learning model may be a type of pretrained neural network. For example, the division learning model may be a neural network that outputs a plurality of work zones divided from the land when land-related information is input. Specifically, the application server may input the area of the land, information representing the topography of the land, a floor plan corresponding to the land, and the number of divisions of the land to the division learning model. Next, the application server may output information indicating a plurality of work zones divided from the land from the division learning model.

In step S204, the application server may match a drone control operator for each of a plurality of divided work areas among a plurality of drone control operators registered in the application. For example, a control operation using drones may be performed by different drone control operators for each of a plurality of work areas divided from the land. The application server may assign a drone controller to be in charge of a corresponding work area for each of a plurality of work areas. The application server can shorten the period for completing the control work for the entire land by allowing different drone control operators to perform drone control work for each of a plurality of divided work areas.

According to an embodiment, the application server may receive profiles of each of a plurality of drone controllers from a plurality of drone controllers. The profile of the drone control operator may include at least one of an activity area of the control operator, drone control history information of the control operator, and an evaluation result of the control operator. The application server may allocate a drone control operator to control each of a plurality of work areas divided from the land based on the profile of each of the plurality of drone control operators.

In step S205, the application server may generate control completion data for the control operation performed by the matched drone control operator. The control completion data may be information indicating that the drone control service for the land has been completed. The control completion data is at least one of control video data captured in the process of carrying out control work, moving route of the drone, control chemical amount, flow rate used during control, total control time, total control area, and accident-related information that occurred during control. can include

According to an embodiment, the control completion data may be generated as soon as the control operation for the corresponding work area is completed by the matched drone control operator. The application server can monitor in real time whether control of a specific work area has been completed. For example, the application server may collect data related to the drone control status through a monitoring module mounted on the control drone. Alternatively, the application server may provide a control operator interface allowing control completion details to be input when control of the work area assigned to the matched drone control operator is completed. When the matched drone control operator completes the control work for the assigned work area, the matched drone control operator may input control completion details through the control operator interface provided in the application.

If control is completed for a specific work area according to the monitoring results in real time, the application server may generate control completion data for the work area. When control of all work zones belonging to the land is completed, the application server may collect control completion data for individual work zones and generate control completion data for the entire land.

In step S206, the application server may transmit the generated control completion data to the terminal of the job requester. The application server may provide control completion data to the work client through the application. For example, the application server may generate output information including control completion data. The application server may transmit the generated output information to the terminal of the job requester. The terminal of the job client may output the received output information through an application providing screen.

On the other hand, as described above, the application server may provide a plurality of different service types according to the control service quality. At this time, the payment price for the drone control service for the land may be determined based on the service type information for the land. For example, the application server may determine a service unit price per control area based on service type information for land. The application server may generate payment information for the drone control service for the land based on the service unit price per control area. The application server may provide a payment interface including the generated payment information to the job requester.

Hereinafter, a method of providing a plurality of service types by an application server according to an embodiment of the present invention will be described with reference to FIG. 3 .

3 is a diagram showing an example of a job client interface 30 provided by an application server. The work client interface 30 may be displayed through the work client terminal 31 . The task client may input a request for drone control work through the task client terminal 31 . Referring to FIG. 3 , the application server may provide a window for inputting information related to a drone control request through the job client terminal 31 . For example, the application server may provide the cadastral map 32 obtained based on the location information of the land so that the work client may accurately specify the land.

According to one embodiment, the application server may allow the work client to select a service type for the land. Referring to FIG. 3 , the application server may provide a service type selection button 33 . In the present disclosure, a button does not mean a physical button, but may mean a region divided to obtain a user's input on a screen of a terminal displaying a user interface.

According to one embodiment, when the job client's input to the service type selection button 33 is received, the application server may provide a screen converted to the service type selection window 34 . The service type selection window 34 may include information representing a plurality of service types and characteristics of each of the plurality of service types. For example, the application server can provide land control services using drones according to three service types: 'high-end', 'low-end', and 'low-cost'. In this case, the application server may display characteristics of services provided through each of 'premium', 'advanced', and 'low-price' through the service type selection window 34 .

In addition, the application server may receive, from the job client terminal 31 , input information of a job client selecting one of 'high end', 'low price', and 'low price'. The application server may determine the service type for the land based on the input information received from the job client terminal 31 . In the embodiment of FIG. 3 , the application server is illustrated as providing three types of service, but the present disclosure is not limited thereto.

According to one embodiment, the service cost per area controlled may be determined according to the type of service selected for the land. For example, the request for a drone control operation may include service type information indicating one selected for a drone control service for land from among a plurality of service types. The application server may determine the service unit price per control area based on the service type information. The application server may generate payment information for the drone control service for the land based on the service unit price per control area. Additionally, the application server may provide a payment interface including generated payment information to the job requester.

According to an embodiment, the application server may assign drone control operators belonging to different groups according to service types to control the land. The application server may create a plurality of control operator groups including at least some of the plurality of drone control operators according to the control efficiency score range of each of the plurality of drone control operators. Next, the application server may select any one of a plurality of control company groups based on the service type information. In this case, the higher the service unit price per control area determined according to the service type information, the higher the control efficiency score of each drone control operator belonging to the selected group. The application server may allocate a drone control operator for each of a plurality of work areas divided from the land among drone control operators belonging to the selected control operator group.

Referring to FIG. 3 , when the work client selects 'advanced', the application server may allocate a drone control operator belonging to the first group for each of a plurality of work areas divided from the land. When the work client selects the 'popular type', the application server may allocate a drone control operator belonging to the second group for each of a plurality of work areas divided from the land. When the work client selects 'low-cost', the application server may allocate a drone control operator belonging to the third group for each of a plurality of work areas divided from the land. In this case, the control efficiency score of each of the drone control operators belonging to the first group may be higher than the control efficiency score of each of the drone control operators belonging to the second group. The control efficiency score of each of the drone control operators belonging to the second group may be higher than the control efficiency score of each of the drone control operators belonging to the third group.

According to an embodiment, the control efficiency score may be a score calculated based on drone control history information and evaluation results of each of a plurality of drone control operators. The application server may calculate a control efficiency score of each of the plurality of drone control operators based on drone control history information and evaluation results of each of the plurality of drone control operators. The drone control history information may include information indicating at least one of the number of accidents (X), the average control time per area (T), and the number of drones (N). The evaluation result may include an evaluation score (M) of at least one work client who received a service from a drone control operator. The application server may calculate the control efficiency score (E) for each drone control operator using the equation below. In the equation below, T represents the average control time (minutes) per 1 pyeong of area.

[mathematical expression]

Meanwhile, as described above through step S203 of FIG. 2 , the number of a plurality of work zones divided from the land may be determined according to the type of service for the land. Hereinafter, a method of dividing land into a plurality of work zones based on service types by an application server according to an embodiment of the present invention will be described with reference to FIG. 4 .

4 is a diagram for explaining an example of a plurality of work zones divided from land according to an embodiment of the present invention. Referring to FIG. 4 , the number of a plurality of work zones divided from the land may vary depending on the type of service selected for the land. For example, the higher the unit cost of the type of service selected for the land, the greater the number of multiple work zones subdivided from the land. In addition, the higher the unit price of the service type selected for the land, the smaller the area of each of the plurality of work zones divided from the land. Hereinafter, in FIG. 4, for convenience of description, as in the embodiment of FIG. 3, three types of services having different service unit prices per control area will be described as an example.

Referring to Figure 4, if the service type for the land is the type with the highest service unit price per control area (eg, 'high-end'), the land may be divided into a total of 7 work zones. In this case, the seven divided work areas may have the same shape as the first divided layout 41 . If the type of service for the land is a medium service cost per area treated (eg 'commercial'), the land can be divided into a total of 5 work zones. In this case, the five divided work areas may have the same shape as the second divided layout 42 . If the service type for the land is the type with the lowest service unit cost per area treated (eg, 'low cost'), the land can be divided into a total of three work zones. In this case, the three divided work areas may have the same shape as the third divided layout 43 .

On the other hand, according to an embodiment of the present invention, the application server may display advertisement information through the application screen while drone control work is performed on the land. In the present disclosure, the advertisement information may include at least one of a seller of drone-related goods or parts and information on a drone repair company.

For example, the application server may generate drone-related advertisement information based on land location information. In addition, the application server may expose advertisement information generated to the drone control operator while the drone control operator matched to each of the plurality of work zones divided from the land proceeds with the control operation for the corresponding work zone. The application server may provide location-based advertisement information while the drone control operation is being performed so as to enable rapid response in an accident situation such as drone damage or loss.

Hereinafter, a method in which the application server according to an embodiment of the present invention exposes advertisement information generated according to the service type and the control efficiency score of the drone control operator will be described with reference to FIG. 5 .

5 is a diagram illustrating a screen provided by an application server to a drone control operator while a drone control operation is in progress according to an embodiment of the present invention. In the embodiment of FIG. 5 , the first terminal 51 is a terminal of a first drone control operator performing control on the first land 511 and the second terminal 52 is control control on the second land 521 It may be a terminal of a second drone control operator.

According to an embodiment, the application server may set the advertisement information to be displayed in a larger size at the drone operator's terminal as the service unit price per control area determined according to the service type information is lower. In FIG. 5 , the service type information for the first land 511 may indicate the highest service unit price per control area. In addition, the service type information for the second land 521 may indicate the lowest service unit price per control area. In this case, the size of the first advertisement information 512 displayed on the first terminal 51 while the first drone control operator performs control on the first land 511 is determined by the second drone control operator on the second land 521 ) It may be smaller than the size of the second advertisement information 522 displayed on the second terminal 52 while performing the control.

According to a further embodiment, the application server may expose advertisement information in different ways based on the drone control operator's control efficiency score. According to a specific embodiment, the advertisement information includes fourth advertisement information for a drone repair company located within a predetermined range based on third advertisement information for a vendor selling parts related to a control drone and land location information. can include

In this case, the application server may alternately display each of the third advertisement information and the fourth advertisement information periodically. When the control efficiency score of the drone control operator is lower than or equal to the average control efficiency score of the plurality of drone control operators, the application server is exposed to the fourth advertisement information compared to the first time when the third advertisement information is exposed to the application. The second time period may be set longer.

Conversely, if the control efficiency score of the drone control operator is higher than the average of the control efficiency scores of the plurality of drone control operators, the application server is exposed to the fourth advertisement information compared to the first time when the third advertisement information is exposed to the application. The second time period may be set shorter.

6 is a block diagram showing the configuration of an application server 600 according to an embodiment.

As shown in FIG. 6 , the application server 600 may include a processor 610 , a communication unit 620 and a memory 630 . However, not all of the components shown in FIG. 6 are essential components of the application server 600. The application server 600 may be implemented with more components than those shown in FIG. 6, or the application server 600 may be implemented with fewer components than those shown in FIG. For example, the application server 600 according to some embodiments may further include a user input interface (not shown), an output unit (not shown), etc. in addition to the processor 610, the communication unit 620, and the memory 630. there is.

The processor 610 typically controls the overall operation of the application server 600 . The processor 610 may include one or more processors to control other elements included in the application server 600 . For example, the processor 610 may generally control the communication unit 620 and the memory 630 by executing programs stored in the memory 630 . Also, the processor 610 may perform the functions of the application server 600 described in FIGS. 1 to 5 by executing programs stored in the memory 630 .

According to an embodiment, the processor 610 may receive a request for a drone control operation from a job requester through the communication unit 620 . The processor 610 may receive a request for a drone control operation from a task client terminal through the communication unit 620 . The processor 610 may receive, through the communication unit 620, a request for a drone control task created through an input interface of a task client terminal.

According to an embodiment, the processor 610 may provide a service type selection interface through which a work client may select a service type related to land control work. The processor 610 may determine a service type for the land based on the author's input information received from the terminal of the work client.

The processor 610 may obtain spatial information about land for which a drone control operation is requested. The processor 610 may obtain a cadastral map managed by a national geographic information management agency based on land location information or lot number information. The processor 610 may obtain spatial information on land through a land and forest information inquiry service of a geographic information management institution. For example, the processor 610 may receive at least one of a satellite image, a road view, and a flat cadastral map corresponding to land through the communication unit 620 .

The processor 610 may divide the land into a plurality of work zones in which control work is performed based on the received spatial information. For example, the processor 610 may divide the land into lots and divide a plurality of work zones. According to one embodiment, the processor 610 may determine the number of work zones to be subdivided from the land based on service type information for the land. Processor 610 may divide the land into a determined number of work zones. For example, the higher the unit cost of the type of service selected for the land, the greater the number of multiple work zones subdivided from the land. In addition, the higher the unit price of the service type selected for the land, the smaller the area of each of the plurality of work zones divided from the land.

According to an embodiment, the processor 610 may divide the land using a pre-learned division learning model. Specifically, the processor 610 may input the area of the land, information representing the topography of the land, a floor plan corresponding to the land, and the number of divisions of the land to the division learning model. Next, the processor 610 may output information indicating a plurality of work zones divided from the land from the division learning model.

The processor 610 may match a drone control operator for each of a plurality of divided work areas among a plurality of drone control operators registered in the application. The processor 610 may assign a drone control operator to be in charge of a corresponding work area for each of a plurality of work areas.

According to an embodiment, the processor 610 may assign drone control operators belonging to different groups according to service types to control the land. The processor 610 may generate a plurality of control operator groups including at least some of the plurality of drone control operators according to a control efficiency score interval of each of the plurality of drone control operators. Next, the processor 610 may select any one of a plurality of control company groups based on the service type information. In this case, the higher the service unit price per control area determined according to the service type information, the higher the control efficiency score of each drone control operator belonging to the selected group. The processor 610 may allocate a drone control operator for each of a plurality of work areas divided from the land among drone control operators belonging to the selected control operator group.

The processor 610 may generate control completion data for the control operation performed by the matched drone control operator. The processor 610 may monitor in real time whether control of a specific work area is completed. For example, the processor 610 may collect data related to the drone control status through a monitoring module mounted on the drone for control. Alternatively, the processor 610 may provide an operator interface for inputting control completion details when control of the work area assigned to the matched drone control operator is completed. When the matched drone control operator completes the control work for the assigned work area, the matched drone control operator may input control completion details through the control operator interface provided in the application.

When control is completed for a specific work area according to the monitoring results in real time, the processor 610 may generate control completion data for the work area. When control of all work zones belonging to the land is completed, the processor 610 may collect control completion data for individual work zones and generate control completion data for the entire land.

The processor 610 may transmit the generated control completion data to the terminal of the work client. Processor 610 may generate output information including control completion data. The processor 610 may transmit the generated output information to the terminal of the job requester.

According to an embodiment, the processor 610 may display advertisement information through an application screen while drone control work is performed on the land. The processor 610 may generate drone-related advertisement information based on land location information. In addition, the processor 610 may expose generated advertisement information to the drone control operator while the drone control operator matched to each of the plurality of work zones divided from the land proceeds with the control operation for the corresponding work zone.

The processor 610 may expose advertisement information in different ways based on the control efficiency score of the drone control operator. According to a specific embodiment, the advertisement information includes fourth advertisement information for a drone repair company located within a predetermined range based on third advertisement information for a vendor selling parts related to a control drone and land location information. can include In this case, the processor 610 may alternately display each of the third advertisement information and the fourth advertisement information periodically. When the control efficiency score of the drone control operator is lower than or equal to the average of the control efficiency scores of the plurality of drone control operators, the processor 610 provides the fourth advertisement information to the application compared to the first time when the third advertisement information is exposed to the application. The second exposure time may be set longer. Conversely, if the control efficiency score of the drone control operator is higher than the average of the control efficiency scores of the plurality of drone control operators, the processor 610 sends the fourth advertisement information to the application compared to the first time when the third advertisement information is exposed to the application. The second exposure time may be set shorter.

The communication unit 620 may include one or more components that allow the application server 600 to communicate with the job requester terminal and/or drone control operator terminal of FIG. 1 . The communication unit 620 may transmit/receive data necessary for providing an application related to drone control with a work requester terminal and/or a drone control operator terminal through a network.

For example, the communication unit 620 may receive a request for a drone control task from a task client terminal. The communication unit 620 may receive at least one of a satellite image, a road view, and a flat cadastral map corresponding to land. The communication unit 620 may transmit information about the assigned work area to a drone control company terminal or a drone control company server.

According to an embodiment, the communication unit 620 may transmit output information generated through the processor 610 to a job requester terminal. For example, the communication unit 620 may transmit output information representing the job client interface generated through the processor 610 to the job client terminal so that the job client can select one of a plurality of service types. The communication unit 620 may transmit the control completion data generated by the processor 610 to the work requester terminal. For example, the communication unit 620 may transmit advertisement information generated by the processor 610 to the drone control operator terminal.

The memory 630 may store programs for processing and controlling the processor 610 . For example, the memory 630 may store instructions for operating the application server 600 . Also, the memory 630 may store data generated by the processor 610 . For example, the memory 630 may store control completion data generated by the processor 610 . The memory 630 may store information input to or output from the application server 600 . For example, the memory 630 may store output information including at least one of a job client interface, a drone control operator interface, and advertisement information generated by the processor 610 .

The memory 630 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , an optical disk, and at least one type of storage medium.

Electronic devices according to an embodiment of the present document include, for example, a smart phone, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, and a PMP. It may include at least one of a portable multimedia player, an MP3 player, a medical device, a camera, or a wearable device. A wearable device may be in the form of an accessory (e.g. watch, ring, bracelet, anklet, necklace, eyeglasses, contact lens, or head-mounted-device (HMD)), integrated into textiles or clothing (e.g. electronic garment); In some embodiments, the electronic device may include, for example, a television, a digital video disk (DVD) player, Audio, refrigerator, air conditioner, vacuum cleaner, oven, microwave, washing machine, air purifier, set top box, home automation control panel, security control panel, media box (e.g. Samsung HomeSync ^TM , Apple TV ^TM , or Google TV ^TM ) , a game console (eg, Xbox ^TM , PlayStation ^TM ), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

In another embodiment, the electronic device may include various types of medical devices (e.g., various portable medical measuring devices (such as blood glucose meter, heart rate monitor, blood pressure monitor, or body temperature monitor), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), CT (computed tomography), imager, or ultrasonicator, etc.), navigation device, global navigation satellite system (GNSS), EDR (event data recorder), FDR (flight data recorder), automobile infotainment device, marine electronic equipment (e.g. navigation devices for ships, gyrocompasses, etc.), avionics, security devices, head units for vehicles, industrial or home robots, drones, ATMs in financial institutions, point of sale (POS) in stores of sales), or IoT devices (eg, light bulbs, various sensors, sprinkler devices, fire alarms, thermostats, street lights, toasters, exercise equipment, hot water tanks, heaters, boilers, etc.). According to some embodiments, the electronic device may be a piece of furniture, a building/structure or a vehicle, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, water, electricity, gas, radio wave measuring device, etc.). In one embodiment, the electronic device may be flexible or a combination of two or more of the various devices described above. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (eg, an artificial intelligence electronic device).

1 is a block diagram illustrating an electronic device and a network according to an embodiment of the present invention.

Referring to FIG. 1 , in one embodiment, an electronic device 101 in a network environment 100 is described. The electronic device 101 may include a bus 110, a processor 120, a memory 130, an input/output interface 150, a display 160, and a communication interface 170. In some embodiments, the electronic device 101 may omit at least one of the components or may additionally include other components. Bus 110 may include circuitry that connects components 110-170 to each other and communicates (eg, control messages or data) between components. The processor 120 may include one or more of a central processing unit, an application processor, or a communication processor (CP). The processor 120 may, for example, execute calculations or data processing related to control and/or communication of at least one other component of the electronic device 101 .

Memory 130 may include volatile and/or non-volatile memory. The memory 130 may store, for example, commands or data related to at least one other component of the electronic device 101 . According to one embodiment, memory 130 may store software and/or programs 140 . The program 140 may include, for example, a kernel 141, middleware 143, an application programming interface (API) 145, and/or an application program (or “application”) 147, and the like. . At least part of the kernel 141, middleware 143, or API 145 may be referred to as an operating system. Kernel 141, for example, includes system resources (eg, middleware 143, API 145, or application program 147) used to execute operations or functions implemented in other programs (eg, middleware 143, API 145, or application program 147). : The bus 110, the processor 120, or the memory 130, etc.) can be controlled or managed. In addition, the kernel 141 may provide an interface capable of controlling or managing system resources by accessing individual components of the electronic device 101 from the middleware 143, API 145, or application program 147. can

The middleware 143 may perform an intermediary role so that, for example, the API 145 or the application program 147 communicates with the kernel 141 to exchange data. Also, the middleware 143 may process one or more task requests received from the application program 147 according to priority. For example, the middleware 143 may use system resources (eg, the bus 110, the processor 120, or the memory 130, etc.) of the electronic device 101 for at least one of the application programs 147. Prioritize and process the one or more work requests. The API 145 is an interface for the application 147 to control functions provided by the kernel 141 or the middleware 143, for example, at least for file control, window control, image processing, or text control. It can contain one interface or function (eg command). The input/output interface 150 transmits, for example, a command or data input from a user or other external device to other component(s) of the electronic device 101, or other components of the electronic device 101 ( s) may output commands or data received from the user or other external devices.

The display 160 may be, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical system (MEMS) display, or an electronic paper display. can include The display 160 may display various types of content (eg, text, image, video, icon, and/or symbol) to the user. The display 160 may include a touch screen, and may receive, for example, a touch, gesture, proximity, or hovering input using an electronic pen or a part of the user's body. The communication interface 170 establishes communication between the electronic device 101 and an external device (eg, the first external electronic device 102 , the second external electronic device 104 , or the server 106 ). can For example, the communication interface 170 may be connected to the network 162 through wireless or wired communication to communicate with an external device (eg, the second external electronic device 104 or the server 106).

Wireless communication is, for example, LTE, LTE-A (LTE Advance), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications) may include cellular communication using at least one of the like. According to one embodiment, wireless communication, for example, WiFi (wireless fidelity), Bluetooth, Bluetooth Low Energy (BLE), Zigbee (Zigbee), near field communication (NFC), magnetic secure transmission (Magnetic Secure Transmission), radio It may include at least one of a frequency (RF) and a body area network (BAN). According to one embodiment, wireless communication may include GNSS. GNSS may be, for example, Global Positioning System (GPS), Global Navigation Satellite System (Glonass), Beidou Navigation Satellite System (hereinafter “Beidou”) or Galileo, the European global satellite-based navigation system. Hereinafter, in this document, “GPS” may be used interchangeably with “GNSS”. Wired communication may include, for example, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard 232 (RS-232), power line communication, or plain old telephone service (POTS). there is. Network 162 may include at least one of a telecommunication network, for example, a computer network (eg, LAN or WAN), the Internet, or a telephone network.

Each of the first and second external electronic devices 102 and 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of operations executed in the electronic device 101 may be executed in one or more electronic devices (eg, the electronic devices 102 and 104, or the server 106). According to this, when the electronic device 101 needs to perform a certain function or service automatically or upon request, the electronic device 101 instead of or in addition to executing the function or service by itself, at least some functions related thereto may request another device (eg, the electronic device 102 or 104 or the server 106). The additional function may be executed and the result may be transmitted to the electronic device 101. The electronic device 101 may provide the requested function or service by processing the received result as it is or additionally. For example, cloud computing, distributed computing, or client-server computing technologies may be used.

2 is a block diagram illustrating an electronic device according to an exemplary embodiment.

The electronic device 201 may include, for example, all or part of the electronic device 101 shown in FIG. 1 . The electronic device 201 includes one or more processors (eg, APs) 210, a communication module 220, a subscriber identification module 224, a memory 230, a sensor module 240, an input device 250, a display 260, interface 270, audio module 280, camera module 291, power management module 295, battery 296, indicator 297, and motor 298. Processor The processor 210 may control a plurality of hardware or software components connected to the processor 210 by driving, for example, an operating system or an application program, and may perform various data processing and calculations. ) may be implemented as, for example, a system on chip (SoC) According to one embodiment, the processor 210 may further include a graphic processing unit (GPU) and/or an image signal processor. 210 may include at least some (eg, cellular module 221) of the components shown in Fig. 2. The processor 210 may include at least one of the other components (eg, non-volatile memory). Received commands or data may be loaded into volatile memory for processing, and resultant data may be stored in non-volatile memory.

It may have the same or similar configuration as the communication module 220 (eg, the communication interface 170). The communication module 220 may include, for example, a cellular module 221, a WiFi module 223, a Bluetooth module 225, a GNSS module 227, an NFC module 228 and an RF module 229. there is. The cellular module 221 may provide, for example, a voice call, a video call, a text service, or an Internet service through a communication network. According to an embodiment, the cellular module 221 may identify and authenticate the electronic device 201 within a communication network using the subscriber identity module (eg, SIM card) 224 . According to an embodiment, the cellular module 221 may perform at least some of the functions that the processor 210 may provide. According to one embodiment, the cellular module 221 may include a communication processor (CP). According to some embodiments, at least some (eg, two or more) of the cellular module 221, the WiFi module 223, the Bluetooth module 225, the GNSS module 227, or the NFC module 228 are one integrated chip (IC) or within an IC package. The RF module 229 may transmit and receive communication signals (eg, RF signals), for example. The RF module 229 may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna. According to another embodiment, at least one of the cellular module 221, the WiFi module 223, the Bluetooth module 225, the GNSS module 227, or the NFC module 228 transmits and receives an RF signal through a separate RF module. can The subscriber identification module 224 may include, for example, a card or an embedded SIM including a subscriber identification module, and may include unique identification information (eg, integrated circuit card identifier (ICCID)) or subscriber information (eg, IMSI). (international mobile subscriber identity)).

The memory 230 (eg, the memory 130) may include, for example, an internal memory 232 or an external memory 234. The built-in memory 232 may include, for example, volatile memory (eg, DRAM, SRAM, SDRAM, etc.), non-volatile memory (eg, OTPROM (one time programmable ROM), PROM, EPROM, EEPROM, mask ROM, flash ROM). , a flash memory, a hard drive, or a solid state drive (SSD).The external memory 234 may include a flash drive, for example, a compact flash (CF) or secure digital (SD). ), Micro-SD, Mini-SD, extreme digital (xD), multi-media card (MMC), or memory stick, etc. The external memory 234 is functionally compatible with the electronic device 201 through various interfaces. can be physically or physically connected.

The sensor module 240 may, for example, measure a physical quantity or detect an operating state of the electronic device 201 and convert the measured or sensed information into an electrical signal. The sensor module 240 includes, for example, a gesture sensor 240A, a gyro sensor 240B, an air pressure sensor 240C, a magnetic sensor 240D, an acceleration sensor 240E, a grip sensor 240F, and a proximity sensor ( 240G), color sensor (240H) (e.g. RGB (red, green, blue) sensor), bio sensor (240I), temperature/humidity sensor (240J), light sensor (240K), or UV (ultra violet) ) may include at least one of the sensors 240M. Additionally or alternatively, the sensor module 240 may include, for example, an e-nose sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, It may include an IR (infrared) sensor, an iris sensor, and/or a fingerprint sensor. The sensor module 240 may further include a control circuit for controlling one or more sensors included therein. In some embodiments, the electronic device 201 further includes a processor configured to control the sensor module 240, either as part of the processor 210 or separately, so that while the processor 210 is in a sleep state, The sensor module 240 may be controlled.

The input device 250 may include, for example, a touch panel 252 , a (digital) pen sensor 254 , a key 256 , or an ultrasonic input device 258 . The touch panel 252 may use at least one of, for example, a capacitive type, a pressure-sensitive type, an infrared type, or an ultrasonic type. Also, the touch panel 252 may further include a control circuit. The touch panel 252 may further include a tactile layer to provide a tactile response to the user. The (digital) pen sensor 254 may be, for example, part of a touch panel or may include a separate recognition sheet. Keys 256 may include, for example, hardware buttons, optical keys, or keypads. The ultrasonic input device 258 may detect ultrasonic waves generated from an input tool through a microphone (eg, the microphone 288) and check data corresponding to the detected ultrasonic waves.

The display 260 (eg, the display 160) may include a panel 262, a hologram device 264, a projector 266, and/or a control circuit for controlling them. Panel 262 may be implemented to be flexible, transparent, or wearable, for example. The panel 262 may include the touch panel 252 and one or more modules. According to an embodiment, the panel 262 may include a pressure sensor (or force sensor) capable of measuring the strength of a user's touch. The pressure sensor may be implemented integrally with the touch panel 252 or may be implemented as one or more sensors separate from the touch panel 252 . The hologram device 264 may display a 3D image in the air using interference of light. The projector 266 may display an image by projecting light onto a screen. The screen may be located inside or outside the electronic device 201 , for example. Interface 270 may include, for example, HDMI 272, USB 274, optical interface 276, or D-sub (D-subminiature) 278. Interface 270 may be included in, for example, communication interface 170 shown in FIG. 1 . Additionally or alternatively, the interface 270 may include, for example, a mobile high-definition link (MHL) interface, an SD card/multi-media card (MMC) interface, or an infrared data association (IrDA) compliant interface. there is.

The audio module 280 may, for example, convert a sound and an electrical signal in both directions. At least some components of the audio module 280 may be included in the input/output interface 145 shown in FIG. 1 , for example. The audio module 280 may process sound information input or output through, for example, the speaker 282, the receiver 284, the earphone 286, or the microphone 288. The camera module 291 is, for example, a device capable of capturing still images and moving images. According to an embodiment, the camera module 291 includes one or more image sensors (eg, a front sensor or a rear sensor), a lens, and an image signal processor (ISP). , or a flash (eg, LED or xenon lamp, etc.). The power management module 295 may manage power of the electronic device 201 , for example. According to one embodiment, the power management module 295 may include a power management integrated circuit (PMIC), a charger IC, or a battery or fuel gauge. A PMIC may have a wired and/or wireless charging method. The wireless charging method includes, for example, a magnetic resonance method, a magnetic induction method, or an electromagnetic wave method, and may further include an additional circuit for wireless charging, for example, a coil loop, a resonance circuit, or a rectifier. there is. The battery gauge may measure, for example, the remaining capacity of the battery 296, voltage, current, or temperature during charging. Battery 296 may include, for example, a rechargeable battery and/or a solar cell.

The indicator 297 may indicate a specific state of the electronic device 201 or a part thereof (eg, the processor 210), for example, a booting state, a message state, or a charging state. The motor 298 may convert electrical signals into mechanical vibrations and generate vibrations or haptic effects. The electronic device 201 is, for example, a mobile TV support device capable of processing media data according to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or mediaFlo ^TM (e.g., : GPU) may be included. Each of the components described in this document may be composed of one or more components, and the name of the corresponding component may vary depending on the type of electronic device. In one embodiment, the electronic device (eg, the electronic device 201) is configured as a single entity by omitting some components, further including additional components, or combining some of the components. The functions of the previous corresponding components may be performed identically.

In one embodiment of the present invention, the electronic device 201 (or the electronic device 101) may include a housing including a front surface, a rear surface, and a side surface surrounding a space between the front surface and the rear surface. A touch screen display (eg, the display 260) is disposed within the housing and may be exposed through the front surface. A microphone 288 is disposed within the housing and may be exposed through a portion of the housing. At least one speaker 282 is disposed within the housing and may be exposed through another part of the housing. A hardware button (eg, key 256) may be located on another part of the housing or configured to display on the touchscreen display. A wireless communication circuit (eg, the communication module 220) may be located in the housing. The processor 210 (or processor 120) is located in the housing and may be electrically connected to the touch screen display, the microphone 288, the speaker 282, and the wireless communication circuit. The memory 230 (or the memory 130 ) may be located in the housing and electrically connected to the processor 210 .

In one embodiment of the present invention, the memory 230 is configured to store a first application program including a first user interface for receiving text input, and the memory 230, when executed, the The processor 210 stores instructions that cause a first operation and a second operation to be performed, and the first operation is performed through the button while the first user interface is not displayed on the touch screen display. receiving a user input of a first type, and after receiving the user input of the first type; Receives a first user utterance through the microphone 288 and provides first data for the first user utterance to an external server including an automatic speech recognition (ASR) and intelligence system. and after providing the first data, receiving at least one command for performing a task generated by the intelligent system in response to the first user utterance from the external server, the second operation, While the first user interface is displayed on the touchscreen display, the first user input is received through the button, and after receiving the first type of user input, the second user input is received through the microphone 288. Receiving a user utterance, providing second data for the second user utterance to the external server, and after providing the second data, from the server, by the automatic speech recognition from the second user utterance receive data about generated text, but not commands generated by the intelligent system; The text may be input into the first user interface.

In one embodiment of the present invention, the button may include a physical key located on the side of the housing.

In one embodiment of the present invention, the first type of user input is after pressing the button once, pressing the button twice, pressing the button three times, or pressing the button once It can be either a held press, or a two-time press and hold press on the button.

In one embodiment of the invention, the instructions may further cause the processor to display the first user interface along with a virtual keyboard. The button may not be part of the virtual keyboard.

In one embodiment of the invention, the instructions further cause the processor 210 to receive, from the external server, data for text generated by ASR from the first user utterance within the first action. can cause

In one embodiment of the present invention, the first application program may include at least one of a note application program, an e-mail application program, a web browser application program, or a calendar application program.

In one embodiment of the present invention, the first application program includes a message application, and the instructions cause the processor 210 to, if a selected time period after inputting the text exceeds, the wireless communication circuitry. It can be further caused to transmit automatically input text through.

In one embodiment of the present invention, the instructions further cause the processor 210 to perform a third operation, wherein the third operation is while displaying the first user interface on the touchscreen display. , Receives a second type of user input through the button, receives a third user speech through the microphone after receiving the second type of user input, and responds to the third user speech by the external server. After providing the third data, at least one command for performing a task generated by the intelligent system in response to the third user utterance may be received from the external server. there is.

In one embodiment of the present invention, the instructions further cause the processor 210 to perform a fourth operation, wherein the fourth operation occurs when the first user interface is not displayed on the touch screen display. On the way, the second type of user input is received through the button, and after receiving the second type of user input, a fourth user speech is received through the microphone 288, and the fourth user speech is received. Provides fourth data for the external server to the external server, and after providing the fourth data, in response to the fourth user utterance, at least one command for performing a task generated by the intelligent system is provided. After receiving from an external server, receiving a fifth user speech through the microphone, providing fifth data for the fifth user speech to the external server, and providing the fifth data, 5 In response to user speech, at least one command for performing a task generated by the intelligent system may be received from the external server.

In one embodiment of the present invention, the first type of user input and the second type of user input are different from each other, and include pressing the button once, pressing the button twice, and pressing the button three times. , Pressing and maintaining the button after pressing the button once, or pressing and maintaining the button twice and maintaining the button may be selected.

In one embodiment of the present invention, the memory 230 is further configured to store a second application program including a second user interface for receiving text input, wherein the instructions, when executed, the processor ( 210) further causes a third operation to be performed, the third operation comprising: receiving the first type of user input through the button while displaying the second user interface, receiving a third user utterance through the microphone after the first type of user input is received, and The external server provides third data for the utterance of the third user, and after providing the third data, data for text generated by ASR from the utterance of the third user is received from the external server. while inputting the text into the second user interface, without receiving a command generated by the intelligent system, and inputting the text, and when a selected time period is exceeded, the inputted text is received through the wireless communication circuit. Text can be sent automatically.

In one embodiment of the present invention, the memory 230 is configured to store a first application program including a first user interface for receiving text input, and the memory 230, when executed, the The processor 210 stores instructions that cause a first operation and a second operation to be performed, the first operation receives a first type of user input through the button, and the first type of user input After receiving , the first user utterance is received through the microphone 288, and an external server including an automatic speech recognition (ASR) and intelligence system is configured to receive the first user utterance. Provide first data for, and, after providing the first data, receive at least one command for performing a task generated by the intelligent system in response to the first user utterance from the external server. do, The second operation includes receiving a second type of user input through the button, receiving a second type of user input through the microphone 288 after receiving the second type of user input, and receiving the external user input through the microphone 288. After providing the second data for the second user utterance to the server, and receiving data for text generated by ASR from the second user utterance from the server after providing the second data, A command generated by the intelligent system is not received, and the text can be input into the first user interface.

In one embodiment of the present invention, the instructions may further cause the processor 210 to display the first user interface along with a virtual keyboard, and the button may not be part of the virtual keyboard.

In one embodiment of the invention, the instructions further cause the processor 210 to receive data for text generated by the ASR from the first user utterance within the first action from the external server. can do.

In one embodiment of the present invention, the first application program may include at least one of a note application program, an e-mail application program, a web browser application program, or a calendar application program.

In one embodiment of the present invention, the first application program includes a message application, and the instructions cause the processor 210 to, if a selected time period after inputting the text exceeds, the wireless communication circuitry. It can be further caused to transmit automatically input text through.

In one embodiment of the invention, the instructions may further cause the processor 210 to perform the first operation independently of display on the display of the first user interface.

In one embodiment of the present invention, the instructions include performing the second operation when the processor 210 is at least one of the electronic device being locked or the touch screen display being turned off. can cause more

In one embodiment of the present invention, the instructions may further cause the processor 210 to perform the second operation while displaying the first user interface on the touch screen display.

In one embodiment of the present invention, the memory 230, when executed, allows the processor 210 to receive user utterances through the microphone 288, to perform automatic speech recognition (ASR) or An external server that performs at least one of natural language understanding (NLU), and performs the ASR on the user utterance data together with the user utterance data to obtain the natural language understanding for text obtained. transmits information associated with whether or not to perform the natural language understanding, and if the information indicates not to perform the natural language understanding, receive the text for data on the user's utterance from the external server; If indicated, an instruction causing the external server to receive a command obtained as a result of performing the natural language understanding of the text may be stored.

3 is a block diagram illustrating program modules according to an exemplary embodiment.

According to an embodiment, the program module 310 (eg, the program 140) is an operating system that controls resources related to an electronic device (eg, the electronic device 101) and/or various applications running on the operating system (eg, the electronic device 101). Example: application program 147). The operating system may include, for example, Android ^TM , iOS ^TM , Windows ^TM , Symbian ^TM , Tizen ^TM , or Bada ^TM . Referring to FIG. 3 , the program module 310 includes a kernel 320 (eg kernel 141), middleware 330 (eg middleware 143), (API 360 (eg API 145) ), and/or an application 370 (eg, the application program 147). At least a part of the program module 310 is preloaded on an electronic device, or an external electronic device (eg, an electronic device ( 102, 104), server 106, etc.).

The kernel 320 may include, for example, a system resource manager 321 and/or a device driver 323 . The system resource manager 321 may perform control, allocation, or recovery of system resources. According to one embodiment, the system resource manager 321 may include a process management unit, a memory management unit, or a file system management unit. The device driver 323 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, or an inter-process communication (IPC) driver. . The middleware 330, for example, provides functions commonly required by the application 370 or provides various functions through the API 360 so that the application 370 can use limited system resources inside the electronic device. It can be provided as an application 370 . According to one embodiment, the middleware 330 includes a runtime library 335, an application manager 341, a window manager 342, a multimedia manager 343, a resource manager 344, a power manager 345, a database manager ( 346), a package manager 347, a connectivity manager 348, a notification manager 349, a location manager 350, a graphic manager 351, or a security manager 352.

The runtime library 335 may include, for example, a library module used by a compiler to add new functions through a programming language while the application 370 is being executed. The runtime library 335 may perform input/output management, memory management, or arithmetic function processing. The application manager 341 may manage the life cycle of the application 370 , for example. The window manager 342 may manage GUI resources used in the screen. The multimedia manager 343 may determine a format required for reproducing media files, and encode or decode the media files using a codec suitable for the format. The resource manager 344 may manage a source code of the application 370 or a memory space. The power manager 345 may manage, for example, battery capacity or power, and provide power information necessary for the operation of the electronic device. According to one embodiment, the power manager 345 may interoperate with a basic input/output system (BIOS). The database manager 346 may create, search, or change a database to be used in the application 370 , for example. The package manager 347 may manage installation or update of applications distributed in the form of package files.

The connectivity manager 348 may manage wireless connections, for example. The notification manager 349 may provide a user with an event such as an arrival message, an appointment, or proximity notification. The location manager 350 may manage, for example, location information of an electronic device. The graphic manager 351 may manage, for example, graphic effects to be provided to the user or user interfaces related thereto. Security manager 352 may provide system security or user authentication, for example. According to one embodiment, the middleware 330 may include a telephony manager for managing voice or video call functions of an electronic device or a middleware module capable of forming a combination of functions of the aforementioned components. . According to one embodiment, the middleware 330 may provide modules specialized for each type of operating system. The middleware 330 may dynamically delete some existing components or add new components. The API 360 is, for example, a set of API programming functions, and may be provided in different configurations depending on the operating system. For example, in the case of Android or iOS, one API set can be provided for each platform, and in the case of Tizen, two or more API sets can be provided for each platform.

The application 370 includes, for example, a home 371, a dialer 372, an SMS/MMS 373, an instant message (IM) 374, a browser 375, a camera 376, and an alarm 377. , Contacts (378), Voice Dial (379), Email (380), Calendar (381), Media Player (382), Album (383), Watch (384), Health Care (e.g. exercise or blood sugar measurement) , or environmental information (eg, air pressure, humidity, or temperature information) providing applications. According to an embodiment, the application 370 may include an information exchange application capable of supporting information exchange between an electronic device and an external electronic device. The information exchange application may include, for example, a notification relay application for delivering specific information to an external electronic device or a device management application for managing an external electronic device. For example, a notification delivery application may transfer notification information generated by another application of an electronic device to an external electronic device or may receive notification information from an external electronic device and provide the notification information to a user. The device management application is, for example, a function of an external electronic device communicating with the electronic device (eg, turn-on/turn-off of the external electronic device itself (or some component parts) or display brightness (or resolution)). adjustment), or an application operating in an external electronic device may be installed, deleted, or updated. According to an embodiment, the application 370 may include an application designated according to the properties of an external electronic device (eg, a health management application of a mobile medical device). According to an embodiment, the application 370 may include an application received from an external electronic device. At least a portion of the program module 310 may be implemented (eg, executed) in software, firmware, hardware (eg, the processor 210), or a combination of at least two of them, and a module for performing one or more functions; It can include a program, routine, set of instructions, or process.

Various embodiments described above may be embodied in other specific forms without departing from their technical ideas and essential characteristics. Accordingly, the above detailed description should not be construed as limiting in all respects and should be considered illustrative. The scope of the various embodiments should be determined by a reasonable interpretation of the appended claims, and all changes within the equivalent scope of the various embodiments are included in the scope of the various embodiments. In addition, claims that do not have an explicit citation relationship in the claims may be combined to form an embodiment or may be included as new claims by amendment after filing.

Claims (1)

A method of performing land control based on drone operation through an application.

Images