KR102561602B1 - Control method of server for providing mediation platform for concierge service - Google Patents

Abstract

A method of controlling a server is disclosed. The control method includes, when a service request for at least one service type is received from a customer terminal, acquiring registration information of a plurality of experts corresponding to the service type, combining customer information of a customer terminal with registration information of a plurality of experts. In comparison, selecting at least one expert from among a plurality of experts, supporting transmission and reception of audio data between the expert terminal of the selected expert and the customer terminal to perform a consultation function, when matching between the customer terminal and the expert terminal is established , Obtaining schedule information of a service provided by the expert, and monitoring the expert's service provision by identifying location information of the expert terminal in a time zone included in the obtained schedule information.

Description

Control method of a server providing mediation platform of concierge service { CONTROL METHOD OF SERVER FOR PROVIDING MEDIATION PLATFORM FOR CONCIERGE SERVICE }

The present disclosure relates to a method for controlling a server, and more particularly, to a method for controlling a server that mediates and monitors a concierge service by communicating with a company server, an expert terminal, and a customer terminal.

Traditional concierge service means providing necessary information or services to hotel guests in a luxury hotel.

However, the concept of concierge service has recently expanded beyond hotels to the general market. For example, like the concierge service of a hotel that comes running when you press the bell, services called 'concierge service', 'concierge economy', and 'concierge business' have begun to be provided because the service is realized immediately upon application.

In the case of the United States, the concierge service market has been growing rapidly since 2011, when baby boomers born between 1946 and 1964 began to retire. For example, Amazon Home Service has been providing various services such as home repair, maintenance, and lawn mowing since 2015, and service contents are evolving to meet customer needs, such as piano lessons and smart home installation. Enboy provides more realistic services for seniors, such as buying groceries or picking up medicine from a pharmacy, as well as services optimized for seniors who can request services through a regular phone call. Postmates operates a flat-rate concierge service specializing in delivery that delivers a variety of products to the elderly and single-person households. In addition, Washio, Taskravel, Munchuri, and Agewell provide laundry service, errand service, delivery of customized dishes by chefs, and care services for the elderly.

In Korea, the number of companies providing concierge services using smartphones is rapidly increasing, but most of them focus on food delivery apps targeting young people, and are insufficient to respond to the various needs of consumers. Existing app-based concierge companies are limited to specific businesses and are operated on a small scale. However, most of them fail to generate profits in the early stage of the business due to the increase in basic costs such as public relations personnel, and most of the cases are closed because continuous operation is impossible. As in overseas cases, it is most useful for large companies to enter, but there are many legal restrictions to realize in Korea (ex. Uber, Kakao Taxi).

As of 2021, the elderly population aged 65 or older in Korea was 8,537,000, accounting for 16.5% of the total. If this trend continues, the elderly population will enter a super-aged society with 20.3% of the total population in 2025, four years later, and is expected to reach 30.5% in 2036. Therefore, the outlook for the concierge service field for seniors is very positive, and it is an essential business field.

The present disclosure provides a method for controlling a server that provides a mediation platform enabling a plurality of specialized concierge service providers to interwork with various customers.

The present disclosure provides a method for controlling a server that supports various types of communication such as phone, video phone, avatar, and metaverse, and can manage quality by monitoring a service providing process.

The objects of the present disclosure are not limited to the above-mentioned objects, and other objects and advantages of the present disclosure not mentioned above can be understood by the following description and will be more clearly understood by the embodiments of the present disclosure. Further, it will be readily apparent that the objects and advantages of the present disclosure may be realized by means of the instrumentalities and combinations indicated in the claims.

A method for controlling a server according to an embodiment of the present disclosure includes, when a service request for at least one service type is received from a customer terminal, obtaining registration information of a plurality of experts corresponding to the service type, the customer terminal comparing customer information with registration information of the plurality of experts and selecting at least one expert from among the plurality of experts; supporting transmission and reception of audio data between an expert terminal of the selected expert and the customer terminal, thereby providing a consultation function When matching between the customer terminal and the expert terminal is established, acquiring schedule information of the service provided by the expert, identifying location information of the expert terminal in a time zone included in the obtained schedule information and monitoring the expert's service provision.

The obtaining of the registration information of the plurality of experts may include receiving the registration information of the plurality of experts from at least one company server, and sending at least one artificial intelligence model trained to determine the reliability of the registration information to the plurality of experts. The method may include obtaining reliability of the registration information of each of the plurality of experts by inputting registration information of each expert. Here, in the selecting of at least one expert, registration information of an expert whose registration information reliability is equal to or higher than a predetermined level among the plurality of experts may be compared with customer information of the customer terminal.

In this case, the acquiring of the registration information of the plurality of experts may include receiving registration information of each expert of the first group matched to the service type from a first company server, and registration information of each expert of the first group. obtaining reliability of, receiving registration information of each expert of the second group matched to the service type from a second company server, and obtaining reliability of the registration information of each expert of the second group. can do. Here, the step of selecting at least one expert may include selecting a group having a higher average reliability of registration information among the first group and the second group, and having a certain reliability of registration information among experts in the selected group. Registered information of experts having a numerical value or greater may be compared with customer information of the customer terminal.

Meanwhile, the performing of the counseling function may include comparing the audio data received from the expert terminal with the audio data of the voice included in the expert's registration information to determine whether the speaker matches or not, the received audio data performing a video call by supporting transmission and reception of image data between an expert terminal of the selected expert and the customer terminal, when is not identical with audio data included in the registration information; A step of determining whether faces match by comparing with a profile picture included in the registration information of the expert may be included.

Here, the control method of the server may include calculating a health risk level of the customer of the customer terminal based on the service type and the customer information, and if the calculated health risk level is greater than or equal to a threshold value, the customer included in the customer information The method may include identifying a location of at least one medical institution close to the address, and transmitting the location of the medical institution to the expert terminal when matching between the customer terminal and the expert terminal is established.

In addition, when the service type is a virtual butler service, the control method of the server may include, through the customer terminal, at least one image representing the inside of the customer's residence of the customer terminal, and the inside of the residence. A step of displaying the located avatar may be included. At this time, in the step of displaying the avatar, based on the weather information, the avatar's clothing or expression may be changed and displayed.

In addition, the control method of the server may include, when a user input for selecting at least one body part among a plurality of body parts constituting the avatar is received, performing a function related to a medical institution matched to the selected body part; and performing a function related to the selected object when a user input for selecting at least one object present in the image is received.

Here, the control method of the server may further include adding at least one object to the image according to a user input received through the customer terminal. The object may correspond to one of furniture, home appliances, and companion animals.

A method of controlling a server according to the present disclosure may analyze registration information of a plurality of experts according to the type of concierge service requested by a customer terminal, recommend a most suitable expert to a customer, and provide a counseling function.

The method for controlling a server according to the present disclosure contributes to creating an environment capable of managing the quality of concierge services and building a trusting relationship between companies/experts/customers by monitoring not only the consultation process but also the service provision process in real time.

1 is a block diagram for explaining the operation of a server that communicates with various terminals according to an embodiment of the present disclosure;
2 is a flowchart for explaining a method of controlling a server according to an embodiment of the present disclosure;
3 is a diagram for explaining an operation in which a server receives expert registration information for each service type from various company terminals according to an embodiment of the present disclosure;
4 is a diagram for explaining specific functions activated in a process of monitoring a service provision process by a server according to an embodiment of the present disclosure; and
5 is a diagram for explaining an operation in which a server automatically provides a concierge service through a butler avatar according to an embodiment of the present disclosure.

Prior to a detailed description of the present disclosure, the method of describing the present specification and drawings will be described.

First, terms used in the present specification and claims are general terms in consideration of functions in various embodiments of the present disclosure. However, these terms may vary depending on the intention of a technician working in the art, legal or technical interpretation, and the emergence of new technologies. In addition, some terms are arbitrarily selected by the applicant. These terms may be interpreted as the meanings defined in this specification, and if there is no specific term definition, they may be interpreted based on the overall content of this specification and common technical knowledge in the art.

In addition, the same reference numerals or numerals in each drawing attached to this specification indicate parts or components that perform substantially the same function. For convenience of description and understanding, the same reference numerals or symbols are used in different embodiments. That is, even if all components having the same reference numerals are shown in a plurality of drawings, the plurality of drawings do not mean one embodiment.

Also, in the present specification and claims, terms including ordinal numbers such as “first” and “second” may be used to distinguish between elements. These ordinal numbers are used to distinguish the same or similar components from each other, and the meaning of the term should not be construed as being limited due to the use of these ordinal numbers. For example, the order of use or arrangement of elements associated with such ordinal numbers should not be limited by the number. If necessary, each ordinal number may be used interchangeably.

In this specification, singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "comprise" or "consist of" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other It should be understood that the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof is not precluded.

In the embodiments of the present disclosure, terms such as “module,” “unit,” and “part” are terms used to refer to components that perform at least one function or operation, and these components are hardware or software. It may be implemented or implemented as a combination of hardware and software. In addition, a plurality of "modules", "units", "parts", etc. are integrated into at least one module or chip, except for cases where each of them needs to be implemented with separate specific hardware, so that at least one processor can be implemented as

Also, in an embodiment of the present disclosure, when a part is said to be connected to another part, this includes not only a direct connection but also an indirect connection through another medium. In addition, the meaning that a certain part includes a certain component means that it may further include other components without excluding other components unless otherwise stated.

1 is a block diagram illustrating an operation of a server that communicates with various terminals according to an embodiment of the present disclosure.

Referring to FIG. 1 , the server 100 may communicate with at least one customer terminal 200 and at least one expert terminal 300 .

The server 100 may be an electronic device or system composed of one or more computers.

The server 100 may include one or more processors and one or more memories, and may perform communication with a customer terminal according to various communication methods.

The server 100 may be connected to an external terminal through one or more networks.

The network may be a Personal Area Network (PAN), a Local Area Network (LAN), a Wide Area Network (WAN), etc., depending on the area or size, and an intranet, It may be an extranet or the Internet.

The server 100 is long-term evolution (LTE), LTE Advance (LTE-A), 5th generation (5G) mobile communication, code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS) , WiBro (Wireless Broadband), GSM (Global System for Mobile Communications), DMA (Time Division Multiple Access), WiFi (Wi-Fi), WiFi Direct, Bluetooth, NFC (near field communication), Zigbee, etc. It can be connected with external devices through

In addition, the server 100 may be connected to a user terminal through a wired communication method such as Ethernet, optical network, Universal Serial Bus (USB), or Thunderbolt.

The server 100 may mediate a concierge service transaction between a customer and an expert through at least one application or web page.

The customer terminal 200 may correspond to a terminal of a customer who wants to receive a concierge service, and may correspond to various electronic devices such as a smart phone, a wearable device, a tablet PC, and a desktop PC.

The expert terminal 300 may correspond to a terminal of an expert providing a concierge service, and may correspond to various electronic devices such as a smart phone, a wearable device, a tablet PC, and a desktop PC.

In addition, the server 100 may perform communication with servers of various companies. The company server may correspond to a server of a company that holds registration information on various experts. Specifically, the server 100 may receive registration information on various experts from a company terminal.

2 is a flowchart illustrating a method for controlling a server according to an embodiment of the present disclosure.

Referring to FIG. 2 , the electronic device 100 may receive a service request for at least one service type from the customer terminal 200 . In addition, the electronic device 100 may acquire registration information of a plurality of experts corresponding to the service type (S210).

The registration information includes the expert's name, gender, region, education, experience, history, qualification information, area of expertise, type of service provided, history of service provision, affiliated company, self-introduction, contact information, customer rating, and voice of the expert. It can include various items such as audio data about the patient and a profile picture of a specialist.

Specifically, the server 100 may receive registration information of experts matching the service type requested by the customer terminal 200 from various company servers.

In relation to this, FIG. 3 is a diagram for explaining an operation in which a server receives expert registration information for each service type from various company terminals according to an embodiment of the present disclosure.

Referring to FIG. 3 , the server 100 communicates with servers of various companies, such as a first company server 400-1, a second company server 400-2, and a third company server 400-3. can do. Each company server may include registration information of various experts for each service type.

For example, when a service request for the first service type is received from the customer terminal 200, the server 100 may receive registration information of experts capable of providing the service of the first service type from each company server. can

The server 100 may perform verification on registration information. For example, if qualification information is included in expert registration information, it may be determined whether the corresponding qualification information is falsified. At this time, at least one artificial intelligence model (ex. CNN) that determines whether or not it is forged can be used, and this artificial intelligence model will be trained to determine the authenticity based on images of various documents such as real certificate images and false certificate images. can

For example, when the probability that the qualification information is false is high, the server 100 may set the reliability of the registration information low.

Here, reliability is an index indicating the level of trust in registered information of an expert.

In addition, as an embodiment, the server 100 may verify each expert's registration information received from each company server by using an artificial intelligence model trained to determine the reliability of the registration information.

An artificial intelligence model that determines reliability can be trained based on registration information of various experts, as well as registration information of experts written falsely. In this case, the artificial intelligence model may be trained to determine high reliability for registration information of real experts and low reliability for registration information of false experts.

Artificial intelligence models can be built in various forms such as machine learning and deep learning, and can be trained by various training methods such as supervised learning, unsupervised learning, and reinforcement learning.

For example, an artificial intelligence model understands natural language by recognizing the text of each item constituting registration information (ex. region, career, education, history, qualification information, field of expertise, service type, service provision history, etc.) It may include at least one module for For example, a module for extracting keywords included in text and converting them into at least one vector may be included.

In addition, the artificial intelligence model may include a module for outputting reliability by analyzing a vector obtained by converting each item. This module may be composed of one or more layers, may be updated through a medium of weights between nodes of different layers, and may be configured to determine reliability based on correlation or contradiction between keywords.

The server 100 may acquire the reliability of the registration information of each expert by inputting the registration information of each expert to the corresponding artificial intelligence model.

In addition, the server 100 may select at least one expert from among the plurality of experts by comparing customer information of the customer terminal 200 (transmitting the service request) with registration information of a plurality of experts previously obtained (S220). ).

Customer information may include various items such as the customer's name, age, presence or absence of disease, type of disease, address, service request history, contact information, audio data of the customer's voice, and profile picture of the customer.

Specifically, the server 100 may calculate a plurality of goodness of fit between items by comparing each item constituting customer information with each item constituting expert registration information, and select at least one expert having the best fit between items. You can choose.

For example, the server 100 calculates a first fitness by comparing the customer's address and the expert's location, calculates a second fitness by comparing the customer's age and the expert's age, and calculates the customer's gender and expert's age. A third goodness of fit can be calculated by comparing the sex of the customer, and a fourth goodness of fit can be calculated by comparing the customer's disease and the specialist's area of expertise/career/career. In addition, the server 100 may obtain an average value of the above-described suitability for each expert.

Here, the server 100 may compare only the registration information of an expert whose registration information reliability is equal to or higher than a predetermined value from among a plurality of experts with the customer information of the customer terminal. In this case, the load of the server 100 can be operated relatively efficiently because the degree of fitness is not calculated for all experts for which registration information has been collected.

In addition, the server 100 may utilize at least one artificial intelligence model that outputs a matching score between a customer and an expert based on customer information of a customer and registration information of an expert.

This artificial intelligence model can be trained based on the registered information of an expert selected by an actual customer as a result of providing the registered information of a plurality of experts to the customer. In this case, training may be performed so that the matching score of the registered information of the selected expert is output higher and the matching score of the registration information of the unselected expert is output lower.

For example, the server 100 may input customer information of a customer requesting a service into an artificial intelligence model, and sequentially input registration information of each of a plurality of experts to obtain a matching score for each expert. And, the server 100 may select an expert with the highest matching score.

Meanwhile, the server 100 may calculate the reliability of the registration information of experts received from each company server and calculate an average of the reliability for each company.

For example, the server 100 receives registration information of each expert of the first group matching the type of service (requested) from the server 400-1 of the first company, and registers information of each expert of the first group. reliability can be obtained. In addition, the server 100 receives registration information of each expert of the second group matched to the corresponding service type from the second company server 400-2, and obtains reliability of the registration information of each expert of the second group. can

In this case, the server 100 may select a group having a higher average reliability of registration information among the first group and the second group, and may compare customer information of customers only with registration information of experts belonging to the selected group. In this case, as a result of comparing only the registered information of experts whose reliability of the registered information is higher than a certain value with the customer information of the customer terminal, the load of the server 100 can be efficiently operated.

In addition, the server 100 may identify a company that provided registration information of the selected group.

For example, in the process of receiving multiple service requests from customer terminals, each company server may provide registration information of experts (groups) each time a service request is received. In this case, the server 100 may identify which group registration information provided by a company has been adopted (according to an average value of reliability) whenever a service request is received.

As a result, for each company (ex. 400-1, 2, 3), the number of times adopted as a result of providing the registration information of the expert group can be stored.

Thereafter, as a service request for at least one service type is received from at least one customer terminal, the server 100 may set more registration information of experts received from the company server of a company that has been adopted more frequently. there is.

For example, as a result of comparing the reliability of registration information provided by each company server whenever a service request is received, the proportion of group registration information provided by the first company server 400-1 is 30%; If the ratio of group registration information provided by the second company server 400-2 is 20% and the ratio of group registration information provided by the third party server 400-3 is 10%, Assume.

Here, when a service request for one service type is received from at least one customer terminal, the server 100 receives registration information about A expert from the first company server 400-1, and second Registration information on B experts may be received from the company server 400-2, and registration information on C experts may be received from the third company server 400-3. At this time, according to the above specific gravity, A > B > C may be satisfied.

As a result, the more a company has a history of providing registration information of a group with high average reliability, the more opportunities it has to provide the registration information of a larger number of (affiliated) experts in the future. Increased odds of matching. That is, overall reliability of expert registration information may be improved and a fair competition environment may be provided. In addition, in the case of a company with a large number of adoptions, since the number of experts who need to provide registration information gradually increases, it becomes more difficult in terms of managing average reliability, which has the advantage that an appropriate balance can be struck.

In addition, as an example, the ratio of A:B:C may also be set to be the same as the above-mentioned specific gravity (ex. A: 30 people, B: 20 people, C: 10 people). However, the amount of registration information (: number of experts) that can be received from at least one company server may not reach the above-mentioned number. For example, in the case of the second company server 400-2, only registration information for 16 experts less than 20 may be provided.

In this case, the server 100 may similarly reduce the amount of registration information (: number of experts) received from the servers of other companies (eg, 400-1 and 3). For example, the server 100 sends 27, 17, and 7 experts from the first company server 400-1, the second company server 400-2, and the third company server 400-3, respectively. registration information can be received.

In addition, the server 100 may perform a counseling function by supporting transmission and reception of audio data between the expert terminal 300 of the selected expert and the customer terminal 200 according to various embodiments described above (S230).

In this case, the server 100 may support transmission of image data input through each terminal as well as supporting transmission of audio data received from each terminal. In this case, a video call may be provided.

At this time, the audio data/image data may be directly transferred to each terminal via the server 100, or as a result of providing the contact information or access address of each terminal to the terminals through the server 100, the corresponding contact or access address A call (or video call) between terminals may be conducted through.

In relation to this, FIG. 4 is a diagram for explaining specific functions activated in a process of monitoring a service providing process by a server according to an embodiment of the present disclosure.

Referring to FIG. 4 , the server 100 may provide consultation between the expert terminal 300 of the previously selected expert and the customer terminal 200 (requesting the service).

At this time, the server 100 may perform various monitoring functions while consultation (eg, call) is in progress.

For example, the server 100 may perform voice recognition using audio data received from each terminal or perform facial recognition for a customer/expert based on image data. In this case, the server 100 may compare audio data and image data received from the customer terminal 200 with the customer's voice and profile picture included in the customer information, respectively. Similarly, the server 100 may compare audio data and image data received from the expert terminal 300 with the expert's voice and profile picture included in the expert's registration information, respectively.

As an embodiment, the server 100 may compare audio data received from the expert terminal 300 with audio data of voice included in expert registration information to determine whether the speaker matches.

Here, if the received audio data does not match the audio data included in the registration information, the server 100 supports transmission and reception of image data between the expert terminal 300 of the selected expert and the customer terminal 200, thereby making a video call. can be performed.

In this case, the server 100 may compare the image data received from the expert terminal 300 with the profile picture included in the expert's registration information to determine whether or not the faces match, as well as determine whether the face matches the expert's registration information. A profile picture may be provided through the customer terminal 200 . In this case, the customer can check whether the face of the expert according to the registered information matches the face of the expert currently in the video call.

As such, the server 100 according to the present embodiment can prevent falsification of personal information or counseling by a false expert by selectively activating a video call when a speaker does not match according to voice recognition.

When a request for matching with a corresponding expert is received from the customer terminal 200 after the above-described consultation, the server 100 may register matching between the customer and the expert. Then, the expert can provide the concierge service requested by the customer.

As such, when matching between the customer terminal 200 and the expert terminal 300 is set, the server 100 may obtain schedule information of the service provided by the expert (S240).

The schedule information may include information about a service provision date/time, etc. determined according to an agreement between a customer and an expert. In addition, schedule information may also include information about a place where a corresponding service is provided on a service provision date/time.

Schedule information may be received according to a user input received through the customer terminal 200 and/or the expert terminal 300 .

In addition, the server 100 may identify the location information of the expert terminal 300 in a time zone included in the schedule information to monitor the expert's service provision (S250). That is, location information of the expert terminal 300 may be monitored during a time period in which the service is to be provided.

For example, the server 100 may identify location information by receiving Global Positioning System (GPS) information of the expert terminal 300 from the expert terminal 300 .

In this case, the server 100 may monitor whether the actual service is being provided by comparing a place where the service is to be provided with location information of the expert terminal 300 . When the location information of the expert terminal 300 is separated from the service providing place by a certain distance or more, the server 100 may transmit the location information of the expert terminal 300 to the customer terminal 200 and/or the company server to which the expert belongs. there is.

Similarly, the server 100 may monitor location information of the customer terminal 200 according to schedule information for providing services. In this case, the monitoring result (the customer's location information) may be transmitted to the pre-registered guardian's terminal and/or expert's terminal 300 .

Meanwhile, as an example, the server 100 may identify and provide the location of a medical institution according to the customer's health risk.

Specifically, the server 100 may calculate the health risk of the customer based on the type of service requested by the customer and customer information. For example, when the service type is a preset service type (eg care, hospital visit and return assistance, daily assistance, etc.), the health risk may be calculated relatively high. For example, the higher the age of the customer identified according to the customer information, the higher the health risk may be calculated.

Here, when the calculated health risk is greater than or equal to the critical value, the server 100 may identify the location of at least one medical institution that is close to the customer address included in the customer information. In addition, the server 100 may transmit the location of the corresponding medical institution to the expert terminal 300 of the expert matched with the customer.

Meanwhile, the server 100 may provide various concierge services related to house management based on virtual avatars in addition to matching with actual experts.

In relation to this, FIG. 5 is a diagram for explaining an operation in which a server automatically provides a concierge service through a butler avatar according to an embodiment of the present disclosure. 5 is an example of an image displayed on a customer terminal 200 that accesses an application and/or a web page provided by the server 100. 5 assumes that the service type requested by the customer is 'virtual butler service'.

Referring to FIG. 5 , the server 100 creates an avatar 520 located inside the customer terminal 200 together with at least one image 510 representing the inside of the customer's residence (address). The customer terminal 200 may be controlled to display.

The avatar 520 may represent a virtual butler, and based on weather information, the avatar's clothing or expression may be changed. At this time, the server 100 may inform the weather precautions (eg, fine dust warning/warning, cold wave, ice) through the avatar 520, and may recommend other walking indexes, outing clothes, and the like.

In addition, the server 100 may provide a concierge service according to various user commands received through the avatar 520 . In this case, the user command may be input through touch or voice.

As an embodiment, when a user input for selecting at least one body part among a plurality of body parts constituting the avatar 520 is received, the server 100 may perform a function related to a medical institution matched to the selected body part. there is. For example, when the arm or leg of the avatar 520 is selected, the server 100 may remotely perform tasks related to orthopedics or dermatology (eg, medical appointment reservation, remote medical treatment application, etc.). For example, when a user input for selecting the nose or mouth of the avatar 520 is received, the server 100 may perform tasks related to otolaryngology (eg, medical appointment reservation, telemedicine application, etc.). To this end, the server 100 may communicate with servers of various medical institutions.

In addition, the server 100 may provide a matching process with at least one expert who will provide a concierge service, such as assistance in visiting a medical institution matched to a selected body part (eg, FIG. 2 ).

In addition, as an embodiment, when a user's voice requesting at least one concierge service from the avatar 520 is received, the server 100 obtains text by analyzing the audio data of the corresponding voice, and matches the obtained text. function can be provided.

Also, referring to FIG. 5 , the server 100 may display various objects in addition to the avatar 520 . Here, the object may correspond to various objects such as furniture, home appliances, and companion animals, but is not limited thereto.

For example, a refrigerator 511, a washing machine 512, a bed 513, a puppy 514, and the like may be displayed, and items of objects displayed in the image 510 may be added/changed according to user input. there is. That is, the customer may add an item of an object (eg, a dog, a refrigerator, etc.) existing in the actual place of residence of the customer through the customer terminal 200 . At this time, the server 100 may register the type of concierge service matched with each item according to the user input. For example, with respect to the refrigerator 511, a shopping function (online shopping), a recipe search function, errands (concierge service: expert matching required), and the like may be registered.

For example, when a user input for selecting (eg, touching) at least one object (eg, bed 513) present in the image 510 is received, the server 100 receives the selected object (eg, bed 513). ))) and related functions (ex. concierge service matching related to bedding washing) may be provided, and at this time, the server 100 may provide at least one expert capable of providing the function in accordance with the embodiment of FIG. 2 described in detail. You can choose together and support the consultation or matching process.

For example, when a user input for selecting a dog 514 present in the image 510 is received, the server 100 sends at least one expert who can provide concierge services such as taking care of a dog and feeding a dog. As in the embodiment of FIG. 2, a counseling or matching process may be supported by selection.

As such, the server 100 mediates experts for providing separate concierge services for each object (ex. 511, 512, 513, 514), while independently managing the payment process for experts, customers, and companies for each object ( ex. subscription/payment by object/service type).

Meanwhile, the various embodiments described above may be implemented by combining two or more embodiments as long as they do not conflict or contradict each other.

Meanwhile, various embodiments described above may be implemented in a recording medium readable by a computer or a similar device using software, hardware, or a combination thereof.

According to the hardware implementation, the embodiments described in this disclosure are application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and field programmable gate arrays (FPGAs). ), processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions.

In some cases, the embodiments described herein may be implemented by a processor itself. According to software implementation, embodiments such as procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules described above may perform one or more functions and operations described herein.

On the other hand, computer instructions or computer programs for performing processing operations in a server, a user terminal, or an electronic device according to various embodiments of the present disclosure described above are provided in a non-transitory computer-readable medium. medium) can be stored. Computer instructions or computer programs stored in such a non-transitory computer readable medium, when executed by a processor of a specific device, cause the specific device to perform processing operations in the server, user terminal, electronic device, etc. according to various embodiments described above. do.

A non-transitory computer readable medium is a medium that stores data semi-permanently and is readable by a device, not a medium that stores data for a short moment, such as a register, cache, or memory. Specific examples of the non-transitory computer readable media may include CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

Although the preferred embodiments of the present disclosure have been shown and described above, the present disclosure is not limited to the specific embodiments described above, and is common in the technical field belonging to the present disclosure without departing from the gist of the present disclosure claimed in the claims. Of course, various modifications and implementations are possible by those with knowledge of, and these modifications should not be individually understood from the technical spirit or perspective of the present disclosure.

100: server 200: user terminal
300: expert terminal

Claims (9)

In the server control method,
acquiring registration information of a plurality of experts corresponding to the service type when a service request for at least one service type is received from a customer terminal;
comparing customer information of the customer terminal with registration information of the plurality of experts, and selecting at least one expert from among the plurality of experts;
performing a counseling function by supporting transmission and reception of audio data between an expert terminal of the selected expert and the customer terminal;
obtaining schedule information of a service provided by the expert when a matching between the customer terminal and the expert terminal is set; and
Identifying the location information of the expert terminal in a time zone included in the obtained schedule information, and monitoring the provision of the expert service; and
Obtaining registration information of the plurality of experts,
receiving registration information of each expert in a first group matched to the service type from a first company server;
obtaining reliability of registered information of each expert in the first group;
receiving registration information of each expert of a second group matched to the service type from a second company server; and
Acquiring reliability of registration information of each expert of the second group;
The step of selecting at least one expert,
Selecting a group having a higher average reliability of registration information among the first group and the second group;
The control method of the server comparing registration information of an expert whose registration information reliability is equal to or higher than a predetermined value among experts of the selected group with customer information of the customer terminal. delete delete According to claim 1,
The step of performing the counseling function is,
comparing audio data received from the expert terminal with audio data of a voice included in the expert's registration information, and determining whether the speaker matches;
performing a video call by supporting transmission and reception of image data between an expert terminal of the selected expert and the client terminal when the received audio data does not match audio data included in the registration information; and
and comparing image data received from the expert's terminal with a profile picture included in the expert's registration information to determine whether faces match. According to claim 1,
The control method of the server,
calculating a health risk of a customer of the customer terminal based on the service type and the customer information;
identifying a location of at least one medical institution close to the customer's address included in the customer information when the calculated health risk is greater than or equal to a critical value; and
and transmitting the location of the medical institution to the expert terminal when matching between the customer terminal and the expert terminal is set. According to claim 1,
The control method of the server,
When the service type is a virtual butler service, displaying, through the customer terminal, an avatar located inside the customer's residence together with at least one image representing the interior of the customer's residence of the customer terminal; Including, the control method of the server. According to claim 6,
The step of displaying the avatar,
A server control method of changing and displaying the avatar's attire or facial expression based on weather information. According to claim 7,
The control method of the server,
performing a function related to a medical institution matched to the selected body part when a user input for selecting at least one body part among a plurality of body parts constituting the avatar is received; and
When a user input for selecting at least one object present in the image is received, performing a function related to the selected object; including, a control method of a server. According to claim 8,
The control method of the server,
Adding at least one object to the image according to a user input received through the customer terminal; further comprising,
the object,
A method for controlling a server corresponding to one of furniture, home appliances, and companion animals.