KR102505215B1 - Control method of server for extracting and providing image of facility during video call, and system - Google Patents

Abstract

A control method of a server providing a facility maintenance platform is disclosed. The control method includes receiving a request for maintenance from a customer terminal, identifying a category and location of a facility subject to maintenance based on a user input received through the customer terminal, and selecting the identified category and location. Based on this, selecting at least one maintenance company from among a plurality of pre-registered maintenance companies, transmitting information on the category and location identified as the selected maintenance company, and receiving information from a terminal of the selected maintenance company. Based on the generated user input, generating a quotation, and providing the generated quotation to a customer terminal.

Description

Server control method and system for extracting and providing an image of a facility during a video call { CONTROL METHOD OF SERVER FOR EXTRACTING AND PROVIDING IMAGE OF FACILITY DURING VIDEO CALL, AND SYSTEM }

The present disclosure relates to a server that provides a maintenance platform for a facility, and more particularly, to a server or system that provides a maintenance platform by performing communication with a customer terminal, a company terminal, and a manager terminal, respectively.

Facility maintenance requires the employment of specialized companies for each type of facility, so a contract between a maintenance company and a customer (site) or a business that supports construction progress is emerging.

However, from the standpoint of the existing operators, there was a problem in that considerable time was wasted in data search and cost verification, and a lot of additional time had to be invested in preparing, storing, and utilizing data related to maintenance work.

However, in many cases, existing business operators merely mediate communication through phone/e-mail/KakaoTalk through managers, and there was a problem in that processing was delayed in the collaboration process due to inconvenience in communication. In addition, there was a problem that the contract and construction of Jung-gu Heating were implemented because the cost of maintenance and maintenance carried out several times or the history of maintenance could not be systematically managed.

Publication No. 10-2019-0133381 (Method of providing brokerage service based on platform for selecting license holders, experienced persons, and managers)

This disclosure is for real-time/business data database (digitization)/immediate communication, verification, maintenance company selection, progress monitoring and decision-making without time and place limitations , It provides servers and systems for building collaboration tools between repair sites and repair companies.

The present disclosure provides a server and a system that provide a system platform that enables smooth communication between a customer (field) requiring maintenance, a maintenance company, and a manager.

The present disclosure provides a server and a system that manages the progress history of maintenance work so that a quote and quality-verified maintenance service is provided.

The objects of the present disclosure are not limited to the above-mentioned objects, and other objects and advantages of the present disclosure not mentioned above can be understood by the following description and will be more clearly understood by the embodiments of the present disclosure. Further, it will be readily apparent that the objects and advantages of the present disclosure may be realized by means of the instrumentalities and combinations indicated in the claims.

According to an embodiment of the present disclosure, a control method of a server providing a maintenance platform for a facility includes receiving a request for maintenance from a customer terminal, based on a user input received through the customer terminal, Identifying a category and location of a facility that is a target of, selecting at least one maintenance company from among a plurality of pre-registered maintenance companies based on the identified category and location, and a terminal of the selected maintenance company. Transmitting information on the identified category and location, generating a quote based on user input received from the terminal of the selected maintenance company (at this time, user input from the customer terminal (ex. selection) , approval) may be generated on the premise that a quotation is received), and providing the generated quotation to the customer terminal. Here, the generated estimate may also be provided to at least one manager terminal.

The step of identifying the category and location may include transmitting one or more chatting messages inquiring about a category to the customer terminal through at least one chatbot module for specifying a facility, from the customer terminal through the chatbot module. Identifying a first category included in the received chatting message, transmitting one or more chatting messages inquiring about a subcategory of the identified first category to the customer terminal through the chatbot module, the chatbot module Through this, it may include identifying a second category included in the chatting message received from the customer terminal.

The control method of the server may include receiving an image of a facility subject to maintenance from the customer terminal, based on customer information of the customer terminal, the received image, the identified category, and the identified location, The method may include generating code information of facilities and transmitting the generated code information to the customer terminal.

In this case, the control method of the server may include registering a warranty period for the facility when maintenance work for the facility for which the code information is generated is completed, adding information on the registered warranty period to the code The method may further include updating information and transmitting the updated code information to the customer terminal.

In the step of identifying the category and location, code information of a facility subject to maintenance may be received from the customer terminal, and the category and location of the facility may be identified based on the received code information.

Meanwhile, the control method of the server may include receiving, from at least one customer terminal, first evaluation information on maintenance work performed on one or more facilities, monitoring information on the maintenance work by at least one manager Transmitting to a terminal, receiving second evaluation information on the maintenance work from the manager terminal, based on the first evaluation information and the second evaluation information, a plurality of maintenance companies in at least one category Generating ranking information of may be further included. In this case, the monitoring information may include a maintenance work estimate, a progress history of the maintenance work, and images of facilities before and after the maintenance work. In the selecting of the maintenance company, at least one maintenance company may be selected based on the identified category, the identified location, and the ranking information.

The control method of the server may include identifying information on quotations adopted in the past for facilities included in the identified category, and setting a unit price for each item included in each of the identified quotations to the generated quotation. It may also include generating verification information by comparing the unit price for each included item, and providing the generated verification information to the customer terminal.

In addition, the control method of the server may include receiving a detailed description of a state of a facility subject to maintenance from the customer terminal, extracting one or more keywords related to maintenance work by analyzing the received detailed description, The method may include recommending one or more maintenance companies that match the extracted keywords based on previously stored progress history and evaluation information of a plurality of maintenance works.

In addition, the control method of the server may include providing a video call between the company terminal and the customer terminal, and transmitting an image captured through the customer terminal while the video call is provided through the customer terminal and the business terminal, respectively. Displaying, and adding a check or memo to the displayed image according to a user input received from the customer terminal or the company terminal.

In this case, the control method of the server inputs a plurality of images respectively displayed on the customer terminal and the company terminal while the video call is provided to at least one AI model for object recognition matching the identified category. Thus, selecting at least one image including a facility from among the plurality of images, converting the voice in the video call into text, converting the selected image and the converted text to the customer terminal, the company terminal, and It may include transmitting to at least one manager terminal.

On the other hand, the control method of the server may include transmitting a notification to the manager terminal for guiding the progress of a product for payment of maintenance construction costs, based on a confirmation request for the notification received through the manager terminal, the manager terminal It may include providing one or more evidential documents related to the payment of the maintenance work cost, generating a settlement number related to the payment of the maintenance work cost, and providing it to the manager terminal. The generated settlement number may not be changed or deleted according to a user input received through the manager terminal.

According to the present disclosure, a server providing a maintenance platform for a facility supports reasonable maintenance work management by matching the maintenance company with the most appropriate maintenance work quality and price competitiveness according to the category and location of the facility requiring maintenance. can

According to the present disclosure, a server providing a facility maintenance platform provides applications or web dashboards for each of customer terminals, company terminals, and manager terminals, so that customers, businesses, and managers in the system can customize their work according to their respective roles. make it possible to do

According to the present disclosure, the server providing a maintenance platform for facilities is a maintenance service reception process, quotation process, supplier selection process, construction progress process, evaluation after completion of construction, settlement, etc. It is shared flexibly/selectively with each company and manager.

1 is a block diagram for explaining the operation of a server that communicates with various terminals according to an embodiment of the present disclosure;
2 is a flowchart for explaining the operation of a server providing a facility maintenance platform according to an embodiment of the present disclosure;
3 is a diagram for explaining the operation of a server that provides a user interface (UI) for specifying a category of a facility through a customer terminal according to an embodiment of the present disclosure;
4A is a view for explaining examples of UIs provided to receive input of categories, quantities, and descriptions of facilities subject to maintenance according to an embodiment of the present disclosure;
4B is a diagram for explaining a case in which a QR code is used to specify a facility according to an embodiment of the present disclosure;
4C is a diagram for explaining an operation in which a server communicates with a customer through a chatbot module to specify a category of a facility according to an embodiment of the present disclosure;
5 is a diagram for explaining an operation in which a server proceeds with a bidding according to a user input received through a manager terminal according to an embodiment of the present disclosure;
6 is a diagram for explaining an operation in which a server provides a list of maintenance services through a company terminal according to an embodiment of the present disclosure;
7 is a diagram for explaining an operation in which a server manages evaluation information of each customer and manager according to an embodiment of the present disclosure;
8 is a diagram for explaining an operation in which a server communicates through a note in a terminal screen during a video call between a customer (site) terminal and a company terminal according to an embodiment of the present disclosure;
9 is a diagram for explaining a web dashboard provided by a server through an administrator terminal according to an embodiment of the present disclosure; and
10 is a block diagram for explaining the configuration of a server according to an embodiment of the present disclosure.

Prior to a detailed description of the present disclosure, the method of describing the present specification and drawings will be described.

First, terms used in the present specification and claims are general terms in consideration of functions in various embodiments of the present disclosure. However, these terms may vary depending on the intention of a technician working in the art, legal or technical interpretation, and the emergence of new technologies. In addition, some terms are arbitrarily selected by the applicant. These terms may be interpreted as the meanings defined in this specification, and if there is no specific term definition, they may be interpreted based on the overall content of this specification and common technical knowledge in the art.

In addition, the same reference numerals or numerals in each drawing attached to this specification indicate parts or components that perform substantially the same function. For convenience of description and understanding, the same reference numerals or symbols are used in different embodiments. That is, even if all components having the same reference numerals are shown in a plurality of drawings, the plurality of drawings do not mean one embodiment.

Also, in the present specification and claims, terms including ordinal numbers such as “first” and “second” may be used to distinguish between elements. These ordinal numbers are used to distinguish the same or similar components from each other, and the meaning of the term should not be construed as being limited due to the use of these ordinal numbers. For example, the order of use or arrangement of elements associated with such ordinal numbers should not be limited by the number. If necessary, each ordinal number may be used interchangeably.

In this specification, singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "comprise" or "consist of" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other It should be understood that the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof is not precluded.

In the embodiments of the present disclosure, terms such as “module,” “unit,” and “part” are terms used to refer to components that perform at least one function or operation, and these components are hardware or software. It may be implemented or implemented as a combination of hardware and software. In addition, a plurality of "modules", "units", "parts", etc. are integrated into at least one module or chip, except for cases where each of them needs to be implemented with separate specific hardware, so that at least one processor can be implemented as

Also, in an embodiment of the present disclosure, when a part is said to be connected to another part, this includes not only a direct connection but also an indirect connection through another medium. In addition, the meaning that a certain part includes a certain component means that it may further include other components without excluding other components unless otherwise stated.

1 is a block diagram illustrating an operation of a server that communicates with various terminals according to an embodiment of the present disclosure.

The server 100 corresponds to a server or system for providing a maintenance platform that mediates/supports a contract or progress of a maintenance service, and may be composed of one or more computers.

Referring to FIG. 1 , the server 100 may communicate with various terminal devices such as a customer terminal 200, a company terminal 300, and a manager terminal 400. In this case, the server 100 may communicate with a plurality of terminal devices through at least one web page or application constituting the maintenance platform described above.

The customer terminal 200 corresponds to a terminal device of a customer capable of requesting maintenance.

A customer may correspond to an owner, manager, occupant, user, etc. of a facility subject to maintenance, but is not limited thereto.

The company terminal 300 corresponds to a terminal device of a maintenance company providing maintenance services.

Maintenance companies refer to companies that provide services such as inspection, repair, replacement, and remodeling of various types/categories of facilities for a fee or free of charge.

The manager terminal 400 corresponds to a terminal device of a manager managing a maintenance platform provided through the server 100 .

Here, the manager may correspond to a member of a company that operates a maintenance platform according to the present disclosure, or a manager of a platform service.

The above-described customer terminal 200, company terminal 300, and manager terminal 400 may correspond to various terminal devices such as smart phones, desktop PCs, tablet PCs, notebook PCs, PDAs, and wearable devices. Alternatively, at least one of the aforementioned customer terminal 200, company terminal 300, and manager terminal 400 may be implemented as at least one server.

2 is a flowchart illustrating an operation of a server providing a facility maintenance platform according to an embodiment of the present disclosure.

Referring to FIG. 2 , the server 100 may receive a maintenance request from the customer terminal 200 (S210).

Specifically, the server 100 may receive a user input requesting maintenance from the customer terminal 200 on which the application is executed. In this case, the server 100 may newly register the requested maintenance service.

Also, the server 100 may identify the category and location of the facility to be maintained based on the user input received through the customer terminal 100 (S220).

A category is a concept for classifying types of facilities. For example, the categories may include ceilings, floors, walls, exterior facades, signs, furnishings, leaks, mechanical facilities, and the like, but are not limited thereto.

As an example, the server 100 may provide UI items corresponding to each of a plurality of categories through the customer terminal 200 .

In this case, a user input (eg, touch, button input, etc.) for selecting at least one UI item (specific category) may be received through the customer terminal 200 .

Here, the server 100 may identify the selected category according to the received user input.

In this regard, FIG. 3 is a diagram for explaining an operation of a server that provides a user interface (UI) for specifying a category of a facility through a customer terminal according to an embodiment of the present disclosure.

Referring to FIG. 3 , the server 100 may provide a UI 310 for searching a category of a facility and a UI 320 for selecting one of a plurality of categories through the customer terminal 200 .

For example, according to a user input for selecting (eg, touching) at least one category in the UI 320, the server 100 may identify a category of a facility that is a maintenance target.

Meanwhile, the server 100 may identify the location of the facility according to a user input or the location of the customer terminal 200 .

As an example, the server 100 may receive a user input for registering a location of a facility (or a location of a customer) through the customer terminal 200 .

Alternatively, the server 100 may receive location information of the customer terminal 200 from the customer terminal 200 and specify the location of the facility according to the received location information. Here, the location information of the customer terminal 200 includes GPS (Global Positioning System) information of the customer terminal 200, identification information of a relay device (ex. wireless router) connected to the customer terminal 200 (matching to location information) ), etc., but is not limited thereto.

In addition, the server 100 may provide a UI through the customer terminal 200 to sequentially receive facility information (upper category, lower category, facility name, quantity, image, detailed description, etc.).

In this regard, FIG. 4A is a diagram for explaining an example of UIs provided to receive input of a category, quantity, and description of a facility subject to maintenance according to an embodiment of the present disclosure.

The UI screens 410 , 420 , 430 , 440 , 450 , and 460 of FIG. 4A may be displayed through the customer terminal 200 connected to the server 100 , respectively.

Specifically, a higher category may be selected through the UI screen 410 and a lower category within the selected upper category may be selected through the UI screen 420 . Thereafter, when a UI screen 430 including information on a plurality of facilities included in the selected subcategory is provided, a specific name of the facility may be selected.

In addition, the number of facilities subject to maintenance may be selected through the UI screen 440 , and photos or videos of facilities subject to maintenance may be uploaded through the UI screen 450 . In this case, an image or video of a facility captured through a camera and/or a microphone of the customer terminal 200 may be transmitted to the server 100 .

In addition, a detailed description of a facility subject to maintenance (eg, facility status, symptoms, problems, and other maintenance-related matters) may be input through the UI screen 460 .

Meanwhile, as an example, the server 100 may identify a category and location of a facility (to be maintained) according to pre-registered facility code information. The code information may be implemented as a QR code, barcode, etc., but is not limited thereto.

In addition to the category and location of the facility, code information can be registered to match information on the facility's name, manufacturer, standard, unit price, quantity, construction company, construction date, warranty period, facility image (ex. link address), etc. .

Specifically, the server 100 may receive code information of a facility subject to maintenance from the customer terminal 200 . Also, the server 100 may identify the category and location of the facility based on the received code information.

As an example, it is assumed that the QR scan 330 is selected on the screen of FIG. 3 . In this case, the QR code of the facility may be photographed through the camera of the customer terminal 200 .

Here, the server 100 may receive an image of the captured QR code from the customer terminal 200, and as a result of recognizing the QR code, detailed information about the facility may be identified as shown in FIG. 4B. As a result, the category and location of the facility may be identified.

In order for the above-described embodiment to be possible, code information on at least one facility needs to be pre-registered.

Specifically, when a maintenance request for a specific facility is first received, the server 100 may receive an image of the corresponding facility from the customer terminal 200 (eg, 450 in FIG. 4A ).

Here, the server 100 may generate facility code information (ex. QR code) based on the customer information of the customer terminal 200, the received image, the category of the facility, and the location of the facility. Specifically, the server 100 may register a new facility and issue a QR code as approval information is received from the manager terminal 400 .

In addition, the server 100 may transmit the generated code information to at least one of the customer terminal 200, the company terminal 300, and the manager terminal 400.

As a result, the customer can store the code information stored in the customer terminal 200 on the customer terminal 200 or receive it in paper form through at least one external device (eg, a printer). The issued QR code can also be used by being attached to a facility or a location around the facility.

Thereafter, information on the corresponding facility may be shared and integratedly managed through the customer terminal 200 and the server 100 according to the code information.

For example, when maintenance work for a facility for which code information is generated is completed (ex. when the server 100 receives a completion report notifying the completion of maintenance work from the company terminal 300), the server 100 ) can register the warranty period for the facility. The server 100 may set a warranty period according to user input received through the company terminal 300 .

Here, the warranty period may mean a period that can be managed free of charge according to maintenance work, but is not limited thereto.

In this case, the server 100 may update the code information of the facility by adding information about the registered warranty period, and transmit the updated code information to at least one of the customer terminal 200 and the manager terminal 400. there is.

Meanwhile, various pieces of information constituting the code information (customer information, received image, category of facilities, and location of facilities) are provided to at least one of the customer terminal 200, the company terminal 300, and the manager terminal 400. It can be changed/updated according to user input received through In this case, detailed search conditions (ex. registration date, category, location, etc.) for facilities may be set, and each facility and code information may be searched and viewed.

In addition, information on a facility matching at least one piece of code information may be deleted according to a user input received through at least one of the customer terminal 200, the company terminal 300, and the manager terminal 400.

Meanwhile, as an example, the server 100 may identify a category and/or location of a facility by exchanging a chatting message with a customer through a chat-bot module.

The chatbot module is a module for chatting with a customer to specify a facility.

The chatbot module is a functional component that can be implemented in hardware and/or software form through a system including the server 100 and the customer terminal 200.

The chatbot module may exchange chatting messages with the customer through at least one of a display, a microphone, and a speaker of the customer terminal 200 .

The chatbot module may include a natural language understanding engine, a question/answer generation engine, a natural language generation engine, and the like.

The natural language understanding engine is a component for mechanically understanding the meaning of text, and can mechanically define the meaning by converting the text into a multi-dimensional vector form.

The query generation engine is a configuration for generating a customer's answer or a response to a query (question/answer) according to the context, and may be composed of a recurrent neural network (RNN)-based neural network model that uses multidimensional vectors as inputs and outputs. However, it is not limited thereto.

Specifically, the query generation engine may identify categories included in the customer's chatting message step by step by using a database including information on categories defined for each step.

The natural language generation engine is a component for converting multidimensional vectors generated through the question/answer generation engine back into text.

The server 100 may transmit to the customer terminal 200 one or more chatting messages inquiring about categories that are subject to maintenance through the chatbot module.

In this case, a chatting message corresponding to a response may be received from the customer terminal 200 . In this case, the server 100 may identify the first category included in the chatting message received from the customer terminal 200 through the chatbot module.

In addition, the server 100 may transmit one or more chatting messages inquiring about subcategories of the identified first category to the customer terminal 200 through the chatbot module. Here, when a chatting message in response is received, the server 100 may identify a second category included in the chatting message received from the customer terminal through the chatbot module.

Here, the second category corresponds to a subcategory of the first category.

In this regard, FIG. 4C is a diagram for explaining an operation in which a server communicates with a customer through a chatbot module to specify a category of a facility according to an embodiment of the present disclosure.

Referring to FIG. 4C , the server 100 may provide a chatting UI 480 linked to the chatbot module through the customer terminal 200 .

Specifically, when a query 481 is provided through the chatbot module, the customer may input a response 481' to the query 481.

In this case, the server 100 may visually provide a plurality of response items (eg, electricity, water supply, ceiling, wall, etc.) matching the query 481 through the customer terminal 200, and at least one A response 481' may be input according to a user input for selecting a response item.

If the category of the facility is identified as “electricity” according to the above-described response 481′, the server 100 may provide an inquiry 482 inquiring about a lower category.

In this case, the server 100 may visually provide a plurality of response items (eg, lighting, security, cooking, air conditioning, etc.) corresponding to the subcategory of “electricity” through the customer terminal 200, A response 482' may be input according to a user input for selecting at least one response item among them. As a result, a subcategory may be identified as “lighting” according to the response 482′.

In addition, the server 100 may provide queries 483 and 484 for inquiring/requesting the number of facilities and photos, respectively. In this case, the customer's response 483' for inputting the quantity may be input, and the camera of the customer terminal 200 for taking a picture of the facility may be activated as the picture taking item 485 is selected.

Referring to FIG. 4C , as soon as a camera is activated, a shooting UI 490 providing an image captured through the camera may be provided. The photographing UI 490 may include an image 491 captured through a camera of the customer terminal 200 or a preview image.

In addition, the shooting UI 490 may provide at least one UI for adding a check or memo on the image. Referring to FIG. 4C , a target facility (lighting) in the image 491 is changed according to a user input. A specific check 492 may be added.

In this way, the image 491 to which the check 492 is added may be transmitted to the server 100, and the server 100 may register the corresponding image 491 in association with the code information of the facility. In addition, the server 100 may transmit the corresponding image 491 to at least one company terminal 300 to be selected through a process of S230 to be described later.

Meanwhile, when the category and/or location of the facility is identified according to various embodiments described above, the server 100 performs at least one maintenance service (among a plurality of pre-registered maintenance companies) according to the identified category and/or location. A company can be selected (S230).

To this end, a plurality of maintenance companies may be registered on the server 100 . For example, a maintenance company may be registered on the server 100 on the premise that membership registration is performed through a company terminal of the maintenance company.

In the process of membership registration, categories may be designated and registered for each maintenance company, and the location of the maintenance company or an area where business trips are possible may be registered together.

The server 100 may select at least one maintenance company matching a category of a facility to be maintained from among a plurality of previously registered maintenance companies.

In addition, the server 100 may select one or more maintenance companies located within a predetermined distance from the location of the facility to be maintained.

For example, when a facility subject to maintenance is a “lighting” category, maintenance companies registered for “lighting” may be primarily selected. In addition, the server 100 may finally select only maintenance companies whose distance from the facility is within a certain distance from among the primarily selected maintenance companies.

Meanwhile, the server 100 may select at least one maintenance company by additionally considering evaluation information of maintenance companies in addition to the category and location of the facility.

The evaluation information corresponds to the customer's and/or manager's evaluation of the past maintenance service (construction) performed by the maintenance company. In this regard, an embodiment in which evaluation information is collected as maintenance service is performed will be described later with reference to FIG. 7 .

Specifically, the server 100 identifies a plurality of maintenance companies according to the category and location of the facility, and among the identified plurality of maintenance companies, a certain number of relatively excellent evaluation information (ex. 5 companies, 10 companies) etc.), you can choose a maintenance company.

Meanwhile, the server 100 sends at least one maintenance company to the customer terminal 200 and the manager terminal 400 through a detailed description of the facility (ex. the detailed description received through the UI screen 460 of FIG. 4A). At least one of these may be recommended.

Specifically, the server 100 may extract one or more keywords related to the maintenance work by analyzing the detailed description.

Here, the server 100 may extract one or more keywords in the detailed description using at least one keyword extraction engine and database. This database may include a number of keywords related to maintenance work.

The keyword extraction engine may obtain a plurality of subtexts by dividing the text constituting the detailed description into words or phrases, and may compare each of the obtained plurality of subtexts with keywords in the database to calculate a degree of agreement. . The degree of coincidence may be numerically calculated according to the distance between vectors in which each word/keyword is converted, but is not limited thereto.

The keyword extraction engine may identify subtext having a matching degree with at least one keyword in the database as a keyword related to maintenance work.

As a result, the keyword extraction engine may extract one or more keywords related to the maintenance work in the detailed description.

In addition, the server 100 may recommend one or more maintenance companies that match the extracted keywords based on previously stored progress history and evaluation information of a plurality of maintenance works.

Specifically, the server 100 compares words/phrases in the text included in the previously stored progress history and evaluation information of a plurality of maintenance works with previously extracted keywords, and performs at least one maintenance project related to the extracted keywords. can be identified.

At this time, the server 100 may generate recommendation information for the maintenance company that has performed the identified maintenance work and provide it to the customer terminal 200 . The recommendation information is information for recommending at least one maintenance company, and may include, but is not limited to, contact information of the maintenance company, evaluation information, maintenance work history, location, and the like.

Meanwhile, when at least one maintenance company is selected according to various embodiments described above, the server 100 may perform a bidding for the selected maintenance company.

Specifically, the server 100 may transmit a request for a quote to the company terminal 300 of the selected maintenance company. In addition, the server 100 may transmit facility information including the category and location of the facility to the company terminal 300 (S240). In this case, the server 100 may transmit code information about facilities.

However, in the bidding process, a bidding method or target (a maintenance company) may be set according to a user input received through the manager terminal 400 .

In this regard, FIG. 5 is a diagram for explaining an operation in which a server proceeds with a bidding according to a user input received through a manager terminal according to an embodiment of the present disclosure.

Referring to FIG. 5 , upon receiving a request for maintenance from a customer terminal 200, the server 100 may provide information 510 on a facility subject to maintenance through the manager terminal 400. .

The facility information 510 may include a facility category, cost information (paid/free), request date, location of the facility, image/video of the facility, detailed description (contents of repair request), and the like.

In this case, the manager may select one of the designated bid 511 and the open bid 512 through the manager terminal 400 .

The designated bidding 511 means that a bidding is conducted only for a maintenance company designated by a manager, and the open bidding 512 means that a bidding is conducted openly without being designated by a manager. Specifically, the open bidding 512 means that all maintenance companies registered on the server 100 (on the platform) are designated, or maintenance companies voluntarily participate in bidding through an announced bidding notice.

For example, when the designated bid 511 is selected, as shown on the right side of FIG. A UI 521 for this may be provided.

This list 520 may include maintenance companies selected in step S230 (: maintenance companies selected according to the category, location, etc., of facilities subject to maintenance). Alternatively, the list 520 may include all maintenance companies matching the category of facilities.

This list 520 may include evaluation information (eg, ratings) of each maintenance company in the list 520, information about a location (address), information about a distance from a facility, and the like.

In addition, within the list 520, a maintenance company that is closer to the facility and/or has a higher rating may be displayed higher than other maintenance companies.

Within this list 520, at least one maintenance company may be designated according to a user input (manager), and the server 100 may perform bidding only for the designated maintenance company. Specifically, the server 100 may request a quote from a designated maintenance company terminal through the manager terminal 400 and transmit information about facilities.

As another example, when the open bidding 512 is selected, the server 100 may directly proceed with bidding for maintenance companies without providing a separate list (eg 520) through the manager terminal 400.

Here, maintenance companies that are targets of the open bidding 512 may be companies selected (via the server 100) according to at least one of a category and a location of a facility subject to maintenance.

In addition, the server 100 obtains ranking information of each maintenance company according to evaluation information of each of a plurality of maintenance companies matched to the category of the facility to be maintained, and maintains the maintenance companies corresponding to a certain number of high rankers. may be selected as a target for open bidding 512 .

6 is a diagram for explaining an operation in which a server provides a list of maintenance services through a company terminal according to an embodiment of the present disclosure.

Referring to FIG. 6 , the server 100 may include a quote request list 610 through the company terminal 300 .

The list 610 may include information on one or more maintenance service cases in which maintenance is requested from at least one customer terminal and a maintenance company matching the company terminal 300 is selected as a target for bidding.

This list 610 may include information (eg, category, name, facility location, cost (free/paid), etc.) of each maintenance service facility.

Then, the server 100 may generate or upload a quote (for each company) according to the user input received through the company terminal 300 (S250).

Specifically, at least one maintenance service item in the list 610 may be selected through the company terminal 300 and an estimate may be uploaded.

Alternatively, while at least one maintenance service case in the list 610 is selected through the company terminal 300, a user input for registering various information constituting the quote (eg, unit price for each item, construction period, etc.) is received. It can be. In this case, the server 100 may generate a quote including various registered information.

The estimate may include information on construction period, materials, construction items, cost (ex. unit price per material, unit price per construction item, unit price per site, total cost, etc.), additional services, and the like.

Then, the server 100 may transmit the generated (or uploaded) quotation to at least one of the customer terminal 200 and the manager terminal 400 (S260).

In this case, the server 100 may generate verification information on costs within the quotation generated for each company and provide it to at least one of the customer terminal 200 and the manager terminal 400 .

Specifically, the server 100 may identify information about quotations adopted in the past for facilities included in the identified category (eg, lighting). In addition, the server 100 may generate verification information by comparing the unit price for each item (eg, material item, construction item, etc.) included in each of the identified quotations with the unit price for each item included in the generated quotation.

Verification information includes the average unit price for each item in the past adopted quotations, the estimated total cost reflecting the average unit price for each item within the past adopted quotations, and comparison information with the unit price for each item within the past adopted quotations (ex. 'past adoption 5% cheaper than quoted quotes'), etc., but are not limited thereto.

In addition, the server 100 may provide at least one of the customer terminal and the manager terminal 400 together with each generated quotation, verification information matching each generated quotation.

As a result, the customer can check the quotation for each company through the customer terminal 200, and the server 100 then at least according to the user input received through the customer terminal 200 (and/or the manager terminal 400). We can support signing a maintenance contract with one maintenance company.

In this case, the server 100 may notify each of the customer terminal 200, the company terminal 300, and the manager terminal 400 of the completion of the company selection, and may register information on a successful maintenance contract.

Meanwhile, FIG. 7 is a diagram for explaining an operation in which a server manages evaluation information of each customer and manager according to an embodiment of the present disclosure. 7 assumes a situation after the maintenance work is completed.

Referring to FIG. 7 , the server 100 may receive first evaluation information 711 on maintenance work performed on one or more facilities from the customer terminal 200 . The first evaluation information 711 corresponds to a customer's evaluation of maintenance work. Specifically, as the completion report is received from the company terminal 300, the server 100 may provide at least one notification requesting on-site evaluation to the customer terminal 200. Here, the customer terminal 200 may access a web address through a link provided through the server 100 (eg, included in a notification) and upload at least one evaluation report according to a user input.

The first evaluation information 711 may include evaluation scores or evaluation statements for various items, such as compliance with deadlines, completion of construction, safety management, handling of civil complaints, additional items, images before and after construction, and detailed reviews.

In this case, the server 100 may compare the image before and after construction received through the customer terminal 200 with the image before and after construction received from the company terminal 300 to determine whether the first evaluation information is authentic.

Meanwhile, while the maintenance work is in progress, the server 100 may obtain monitoring information on the maintenance work and transmit it to the manager terminal 400 .

The monitoring information may include a maintenance work estimate, maintenance work progress history, and images of facilities before and after the maintenance work. In addition, the monitoring information may include a completion report on maintenance work, information on the current state of facilities, and the like.

The completion report may be received from the company terminal 300 . Specifically, according to the user input received from the manager terminal 400, the server 100 may transmit a notification (eg, e-mail) including a URL address (link) to the company terminal 300. In this case, the company terminal 300 may access a corresponding link according to a user input, and then a completion report may be uploaded to the server 100 through the company terminal 300 accessing the corresponding link. In addition, uploading of quotes, images/videos for facilities (or materials), and other licenses may be performed according to the above-described method, but is not limited thereto.

Information about the current state of the facility may be received by the server 100 from at least one of the customer terminal 200 and the company terminal 300 .

The progress history of the maintenance work may be updated according to a user input received through the company terminal 300 whenever the construction stage is changed.

Images of facilities before and after maintenance work may be uploaded to the server 100 through the customer terminal 200 or the company terminal 300 .

And, when the maintenance work is completed (eg, the server 100 receives a completion report from the company terminal 300), the server 100 may transmit information indicating that the maintenance work has been completed to the manager terminal 400 .

Here, the server 100 may receive second evaluation information on the maintenance work from the manager terminal 400 . The second evaluation information 712 corresponds to the evaluation of the manager (platform operation side) for the maintenance work.

The second evaluation information 712 is the delivery date compliance, construction schedule calculation rationality, construction completeness, drawing and specification compliance, defect repair and solution presentation, on-site civil complaints, safety measures, response to changing situations, added points, deducted points, etc. Evaluation scores or evaluation statements may be included.

Also, the server 100 may generate ranking information of a plurality of maintenance companies in at least one category based on the first evaluation information and the second evaluation information.

The above-described first evaluation information 711, second evaluation information 712, ranking information, etc. are indicators for determining whether to select/recommend a corresponding company in a maintenance service requested from at least one other customer terminal in the future. It can be used as (ex. S230).

In addition, the server 100, in response to a request from the manager terminal 400 to view at least one maintenance service case for which maintenance work has been completed, first evaluation information 711 and second evaluation information of the corresponding maintenance service case A UI screen 710 including information 712 may be displayed through the manager terminal 400 .

Meanwhile, as an example, the server 100 may compare the customer's first evaluation information and the manager's second evaluation information to determine whether at least one of the first evaluation information and the second evaluation information is authentic.

Specifically, the server 100 may compare an evaluation score according to the first evaluation information and an evaluation score according to the second evaluation information. If the difference between the first evaluation score and the second evaluation score is greater than or equal to a critical value, the server 100 may determine authenticity of each of the first evaluation information and the second evaluation information.

First, the server 100 may verify the authenticity of the first evaluation information.

Here, the server 100 provides a first post-construction image photographed through the customer terminal 200 at the first photographing point for the facility and a second post-construction image photographed through the customer terminal 200 at the second photographic point for the facility. 2 images may be transmitted to the manager terminal 400 .

Thereafter, when the third image and the fourth image respectively captured at the above-described first and second capturing points are received from the manager terminal 400, the server 100 compares the first image with the third image, and The image can be compared with the fourth image.

In this case, the server 100 may identify the reliability of each of the first image and the second image according to the degree of similarity according to the comparison result.

If the identified reliability is less than the critical value, the server 100 may configure evaluation information for the company through second evaluation information excluding the first evaluation information.

On the other hand, when the reliability of each of the first image and the second image is greater than or equal to the threshold value, the server 100 may transmit the first image and the second image to at least one other manager terminal.

Also, the server 100 may receive third evaluation information (including third evaluation scores) of managers of other manager terminals.

At this time, the server 100 compares the third evaluation score with the first evaluation score to calculate the first reliability for the first evaluation score, and compares the third evaluation score with the second evaluation score to calculate the second reliability. can Here, the smaller the difference with the third evaluation score, the higher the reliability can be calculated.

In addition, the server 100 may calculate the final evaluation score included in the evaluation information about the business by applying the first reliability to the first evaluation score and the second reliability to the second evaluation score (eg. Final evaluation score = (first evaluation score * first reliability) + (second evaluation score * second reliability)).

Meanwhile, according to an embodiment, the server 100 may provide a video call between the customer terminal 200 and the company terminal 300 .

In relation to this, FIG. 8 is a diagram for explaining an operation in which a server provides a video call between a customer terminal and a company terminal according to an embodiment of the present disclosure.

The video call of FIG. 8 may, for example, be performed according to a request of the customer terminal 200 after the maintenance company's quotation is transmitted to the customer terminal 200 according to the above-described process S260, but is not limited thereto.

Referring to FIG. 8 , images 810 and 830 captured through the customer terminal 200 while a video call is provided between the customer terminal 200 and the business terminal 300 are the customer terminal 200 and the business terminal 300 ) can be displayed through each.

In addition, the server 100 may add a check or memo to the displayed image according to a user input received from the customer terminal 200 or the company terminal 300 .

As a specific example, when a user's checkmark 821 is input through the memo UI 820 provided through the customer terminal 200, the server 100 displays it on each of the customer terminal 200 and the company terminal 300. Check marks 821 and 821 may be added to the images 810 and 830 to be displayed.

As a result, there is an effect that customers and company officials in different sites can conduct meetings while viewing the same image.

Also, as an embodiment, the server 100 may extract and store at least one image and text within the video call of FIG. 8 .

For example, while a video call is provided, the server 100 inputs a plurality of images sequentially displayed on the customer terminal 200 and the company terminal 300 to an artificial intelligence model for object recognition, and among the plurality of images At least one image including a facility may be selected.

To this end, the server 100 may include a plurality of artificial intelligence models for object recognition matching different categories. A plurality of artificial intelligence models for recognizing objects may be models trained through images of facilities of different categories.

Specifically, the server 100 may select an artificial intelligence model matching a category of a facility subject to maintenance from among a plurality of artificial intelligence models for object recognition, and input a plurality of images in a video call to the artificial intelligence model. .

At this time, the server 100 may select an image in which at least one facility is recognized through an artificial intelligence model.

In addition, the server 100 may convert voice (customer, company related person) in a video call into text. Specifically, the server 100 may convert audio data in a video call into text using at least one of a sound model, a language model, and a pronunciation dictionary.

And, the server 100 may register the selected image and converted text with respect to the corresponding facility. In this case, according to the request of at least one terminal, the server 100 may transmit the selected image and converted text to at least one of the customer terminal 200, the company terminal 300, and the manager terminal 400.

As such, the server 100 according to the present disclosure can not only automatically record the main items of the maintenance service, but also efficiently utilize storage space by selectively storing/registering only images and texts including facilities during recording. .

On the other hand, the video call described above with reference to FIG. 8 can not only be performed between the customer terminal 200 and the company terminal 300, but can be performed between the customer terminal 200 and the manager terminal 400, or the business terminal ( 300) and the manager terminal 400. Alternatively, the video call may be conducted as a three-party video call including all of the customer terminal 200, the company terminal 300, and the manager terminal 400.

Meanwhile, the server 100 may provide the manager terminal 400 with information on various ongoing or completed maintenance services.

In this case, various information on maintenance services can be visualized on the manager terminal 400 in the form of a web dashboard, and FIG. 9 is a UI screen provided by the server 100 through the manager terminal 400. An example is shown.

Referring to FIG. 9 , a menu 910 may be provided through the manager terminal 400 . This menu 910 may include remuneration status, evaluation and settlement, notice management, My Page, and the like.

9 corresponds to the case where “repair status” is selected. When “repair status” is selected, status items such as repair request, estimate request, estimate receipt, construction standby, construction progress, completion report receipt, and site evaluation request are displayed. can be displayed These items correspond to items for selectively checking maintenance service cases by progress.

Referring to FIG. 9 , a UI 920 indicating a maintenance status may be provided through the manager terminal 400, and a list 921 of maintenance service cases and a UI 922 for search may be provided, respectively.

In addition, since the detailed filter UI 930 can be provided through the manager terminal 400, the reception period (based on the time when the request for maintenance is received) and the cost classification (paid/paid) through the detailed filter UI 930. Free of charge), bidding method (designated/open), maintenance company classification (designated/non-designated), progress status, and sorting method (newest/oldest) can be filtered.

And, according to the filtered result, the aforementioned list 921 may be updated.

On the other hand, in addition to this, the server 100 includes various statistical information related to maintenance services, evaluation information (ranking information) for each company, cost information, various form upload tools, facility registration tools, quotation creation and upload tools, report creation tools, A license expiration guide and a contract renewal tool may be provided through the manager terminal 400 .

On the other hand, Figure 10 is a block diagram for explaining the configuration of the server 100 according to an embodiment of the present disclosure.

Referring to FIG. 10 , the server 100 may include at least one memory 110, at least one communication unit 120, and at least one processor 130, respectively.

The memory 110 is a component for storing an operating system (OS) for controlling overall operations of components in the server 100, at least one instruction, and data. The memory 110 may include non-volatile memory such as ROM and flash memory, and may include volatile memory such as DRAM. Also, the memory 110 may include a hard disk, a solid state drive (SSD), and the like.

The communication unit 120 is a component through which the server 100 transmits and receives data with various external devices, and may include at least one circuit or module for communication.

The communication unit 120 includes Transmission Control Protocol/Internet Protocol (TCP/IP), User Datagram Protocol (UDP), Hyper Text Transfer Protocol (HTTP), Secure Hyper Text Transfer Protocol (HTTPS), File Transfer Protocol (FTP), and SFTP ( Various types of information may be transmitted and received with one or more external electronic devices using communication protocols such as Secure File Transfer Protocol (MQTT) and Message Queuing Telemetry Transport (MQTT). The communication unit 120 may use an Ultra Wide Band (UWB) protocol, an NFC protocol, or a protocol for at least one of Augmented Reality (AR) and IoT.

To this end, the communication unit may be connected to an external device based on a network implemented through wired communication and/or wireless communication. In this case, the communication unit 130 may be directly connected to an external device, but may also be connected to an external electronic device through one or more external servers (eg, Internet Service Provider (ISP)) providing a network.

The network may be a Personal Area Network (PAN), a Local Area Network (LAN), a Wide Area Network (WAN), etc., depending on the area or size, and an intranet, It may be an extranet or the Internet.

Wireless communication includes LTE (long-term evolution), LTE-A (LTE Advance), 5G (5th generation) mobile communication, CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband), GSM (Global System for Mobile Communications), DMA (Time Division Multiple Access), WiFi (Wi-Fi), WiFi Direct, Bluetooth, NFC (near field communication), Zigbee, etc. can include

Wired communication may include at least one of communication methods such as Ethernet, optical network, Universal Serial Bus (USB), and Thunderbolt.

Here, the communication unit 120 may include a network interface or network chip according to the wired/wireless communication method described above. On the other hand, the communication method is not limited to the above example, and may include a newly emerging communication method according to the development of technology.

The processor 130 is a component for overall controlling each component included in the server 100, and may control the operation of the server 100 according to various embodiments described above.

The processor 130 may include various units such as a Central Processing Unit (CPU), an Application Processor (AP), a Graphic Processing Unit (GPU), a Visual Processing Unit (VPU), and a Neural Processing Unit (NPU). The processor 130 may control the server 100 by executing instructions stored in memory.

On the other hand, the various embodiments described above may be implemented by combining two or more embodiments as long as they do not conflict or contradict each other.

Meanwhile, various embodiments described above may be implemented in a recording medium readable by a computer or a similar device using software, hardware, or a combination thereof.

According to the hardware implementation, the embodiments described in this disclosure are application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and field programmable gate arrays (FPGAs). ), processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions.

In some cases, the embodiments described herein may be implemented by a processor itself. According to software implementation, embodiments such as procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules described above may perform one or more functions and operations described herein.

Meanwhile, computer instructions or a computer program for performing a processing operation in an electronic device in a server or system according to various embodiments of the present disclosure described above are provided in a non-transitory computer-readable medium ) can be stored in Computer instructions or computer programs stored in such a non-transitory computer readable medium, when executed by a processor of a specific device, cause the above-described specific device to perform processing operations in each device in the server or system according to various embodiments described above. .

A non-transitory computer readable medium refers to a medium that stores data semi-permanently and can be read by a device, not a medium that stores data for a short moment, such as a register, cache, or memory. Specific examples of the non-transitory computer readable medium may include a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

Although the preferred embodiments of the present disclosure have been shown and described above, the present disclosure is not limited to the specific embodiments described above, and is commonly used in the technical field belonging to the present disclosure without departing from the gist of the present disclosure claimed in the claims. Of course, various modifications and implementations are possible by those with knowledge of, and these modifications should not be individually understood from the technical spirit or perspective of the present disclosure.

100: server 200: customer terminal
300: company terminal 400: manager terminal

Claims (1)

In the control method of the server providing the maintenance platform of the facility,
Receiving a request for maintenance from a customer terminal;
identifying a category and location of a facility subject to maintenance based on a user input received through the customer terminal;
selecting at least one maintenance company from among a plurality of pre-registered maintenance companies based on the identified category and location;
Transmitting information about the identified category and location to a terminal of the selected maintenance company;
generating a quote based on a user input received from a terminal of the selected maintenance company; and
Including; providing the generated quote to the customer terminal;
The control method of the server,
providing a video call between the company terminal and the customer terminal;
displaying an image captured through the customer terminal while the video call is provided through the customer terminal and the company terminal, respectively;
At least one object recognition matching the identified category among a plurality of artificial intelligence models for object recognition trained through images of facilities of different categories so that each artificial intelligence model for object recognition recognizes facilities of different categories. Selecting an artificial intelligence model for use;
While the video call is provided, a plurality of images displayed on the customer terminal and the company terminal are input to the selected object recognition artificial intelligence model to select at least one image including a facility among the plurality of images step;
converting audio data transmitted and received within the video call into text;
registering the selected image and the converted text with respect to the facility identified through the artificial intelligence model for object recognition; and
Transmitting the selected image and the converted text to the customer terminal and the company terminal; including, the control method of the server.

Images