TW202322621A - Remote interaction method and system - Google Patents

Abstract

A remote interaction method and system are provided. A client apparatus uses a virtual card to log in to an interactive interface provided by a server to conduct an online meeting with a management apparatus through the interactive interface. After the online meeting ends, the client apparatus obtains a payment notice from the interactive interface and executes a payment action. In response to completing the payment action, the client apparatus obtains an electronic barcode corresponding to an electronic list from the server. The client apparatus transmits the electronic barcode to a store terminal apparatus, so that the store terminal apparatus obtains the electronic list from the server based on the electronic barcode.

Description

Remote interaction method and system

The present invention relates to a remote connection application, and in particular to a remote interactive method and system.

In the post-epidemic era, in order to reduce the number of people going out at home, in terms of medical treatment, people can have medical consultations with doctors through remote video, and then go to the hospital to get a prescription in person or go to the pharmacy to get/buy medicine. Accordingly, the probability of clustering can be slightly reduced. However, during the peak period of the epidemic, the current remote video medical consultation method cannot solve the epidemic problem caused by patients and their families or their agents entering and leaving medical institutions.

The invention provides a remote interaction method and system, which provides a more convenient way of consultation through remote interaction.

The remote interaction method of the present invention includes: using a virtual card to log in to the interactive interface provided by the server through the client device, so as to conduct an online conference with the management device through the interactive interface; The interface obtains the payment notification, and executes the payment action; in response to the completion of the payment action, obtains the electronic barcode corresponding to the electronic list from the server through the client device; and transmits the electronic barcode to the store terminal device through the client device, so that the store terminal device The electronic barcode obtains the electronic list from the server.

In one embodiment of the present invention, after the online meeting is over, it further includes: uploading the electronic list to the server through the management device; and associating the electronic list with the virtual card through the server, and generating a payment corresponding to the electronic list notify.

In one embodiment of the present invention, before uploading the electronic list to the server through the management terminal device, it further includes: connecting to the server through the management terminal device to register, so as to obtain a dedicated certificate from the server; and through the management terminal device Upload the electronic list to the server based on the exclusive certificate.

In one embodiment of the present invention, after transmitting the electronic barcode to the store-side device through the client-side device, it further includes: connecting to the server through the store-side device to obtain an electronic list corresponding to the electronic barcode from the server; The store device connects to the server to change the shipment status of the electronic list.

In one embodiment of the present invention, after connecting to the server through the store-side device to obtain the electronic list corresponding to the electronic barcode from the server, it further includes: verifying whether the electronic list is accompanied by a dedicated certificate through the store-side device, by This judges whether the electronic list is valid.

In one embodiment of the present invention, before using the virtual card to log in to the interactive interface provided by the server through the client device, it further includes: connecting to the server through the client device to register, so that the server issues the virtual card to client device.

In an embodiment of the present invention, the step of connecting to the server through the client device to register includes: sending a first verification code to the client device through the server, and receiving a response from the client device within a specified time period When verifying whether the response matches the first verification code; sending the user information and the second verification code to the server through the client device; and verifying whether the second verification code is valid through the server, so that the response matches the first verification code And when it is determined that the second verification code is valid, the server issues a virtual card to the client device.

In an embodiment of the present invention, during the period of registering with the server through the client device, it further includes: uploading the face image and the device authentication code to the server through the client device, so that the server can pass the authentication code Determine the client device that uploaded the facial image; when the response matches the first verification code and the second verification code and device verification code are valid, the facial features are extracted from the facial image through the server and issued after storing the facial features sending the virtual card to the client device; and associating the facial image with the virtual card through the server.

In an embodiment of the present invention, the remote interaction method further includes: in response to the selection of pick-up at the store through the user-end device, in the store-side device, capturing a facial image through an imaging device for identity authentication , and after passing the identity authentication, read the physical card through the card reader to connect to the server to obtain the electronic list, wherein the physical card is associated with the virtual card; or scan the electronic barcode displayed on the client device through the scanner , to connect to the server to retrieve the electronic list. In response to the home delivery service selected through the client device, the client device transmits recipient information to the store device, so that the store device can assign home delivery work based on the recipient information.

The remote interactive system of the present invention includes: a client device, a management device, a shop device and a server. The server provides an interactive interface. The client device, the management device, the store device and the server are connected through the network. The client device uses the virtual card to log in to the interactive interface, so as to conduct an online meeting with the management device through the interactive interface. After the online meeting ends, the client device obtains the payment notification from the interactive interface, and executes the payment action. In response to completing the payment action, the client device obtains an electronic barcode corresponding to the electronic bill from the server. The user terminal device transmits the electronic barcode to the store terminal device, so that the store terminal device obtains the electronic list from the server based on the electronic barcode.

Based on the above, the present invention uses virtual cards to conduct online meetings, and obtains the 2D barcode of the electronic list associated with the virtual card, and then provides the 2D barcode to the store-end device to perform the pick-up action. Accordingly, remote interaction can be used to provide more convenient consultation methods, and two-dimensional barcodes can be used to pick up goods (personal pick-up, agent pick-up or home delivery), which can greatly reduce the probability of contact with the masses, and solve the problem of patients and their Infection problems caused by family members or their agents entering and leaving medical institutions.

FIG. 1 is a block diagram of a remote interactive system according to an embodiment of the present invention. Please refer to FIG. 1 , the remote interactive system 100 includes a client device 110 , a management device 120 , a server 130 and a store device 140 . The client device 110 , the management device 120 , the server 130 and the store device 140 are connected through the network 150 . The client device 110 , the management device 120 and the store device 140 can be realized by one of a personal computer, a notebook computer, a tablet computer and a smart phone. The server 130 is an electronic device with high computing capability and large storage space.

An embodiment of the above-mentioned remote interaction system 100 is given below to illustrate the steps of the remote interaction method.

FIG. 2 is a flowchart of a remote interaction method according to an embodiment of the invention. Please refer to FIG. 1 and FIG. 2 at the same time. In step S205 , the client device 110 uses the virtual card to log in to the interactive interface provided by the server 130 to conduct an online meeting with the management device 120 through the interactive interface.

In this embodiment, the user first needs to connect to the server 130 through the client device 110 to register, so that the server 130 issues a virtual card to the client device 110 . For example, in the registration process in this embodiment, multi-factor verification is used for verification, and the server 130 will not issue the virtual card until all the verification factors are successful.

The first step of verification: the user connects to the registration interface of the server 130 through the client device 110 and enters the mobile phone number or email address for verification. When the electronic server 130 receives the registration notification via the registration interface, it can send the first verification code to the client device 110 via SMS or email. Here, the first verification code is a one-time password (OTP), and the server 130 verifies the response upon receiving the response from the client device 110 via SMS or email within a specified time period. Whether it meets the first verification code. After it is determined that the response conforms to the first verification code, the second step of verification is continued.

The second verification step is: the user sends the user information and the second verification code to the server 130 through the client device 110 . User information includes the user's name, ID number and/or health insurance card number. The second verification code is, for example, a dynamic verification code generated by an application (APP) installed in the client device 110 and authorized by the server 130 . Taking the client device 110 as a smart phone, an APP authorized by the server 130 can be installed in the client device 110, and after entering the user information in the APP and obtaining the second verification code generated by the APP, the user information and The second verification code is sent to the server 130, so that the server 130 verifies whether the second verification code is valid.

In one embodiment, the server 130 may issue the virtual card to the client device 110 when the received response matches the first verification code and determines that the second verification code is valid. In another embodiment, the server 130 will continue to execute the third step of verification after determining that the second verification code is valid.

The third verification step is: take a facial image of the user through the image capture device of the client device 110 , and upload the facial image and the device authentication code of the client device 110 to the server 130 . The server 130 uses the device authentication code to determine whether the facial image is transmitted by the device that has passed the first step of verification and the second step of verification. After determining that the facial image is sent by the device that has passed the first step of verification and the second step of verification, the server 130 uses an image recognition algorithm to extract facial features from the facial image. The obtained facial features are stored in the corresponding cloud database of the user, and will be provided to the store terminal device 140 for identity verification later.

After the above-mentioned three-step verification is completed, that is, when the response received by the server 130 matches the first verification code and the second verification code is valid, and the facial features are successfully captured and stored, the server 130 issues a virtual card to the client device 110.

After obtaining the virtual card, the client device 110 can log in to the interactive interface provided by the server 130 and conduct an online meeting with the management device 120 through the virtual card.

In step S210, after the online meeting is over, a payment notice is obtained from the interactive interface through the client device 110, and a payment action is performed. After the online meeting ends, the management device 120 will upload the electronic list related to the online meeting to the server 130 . In one embodiment, the management terminal device 120 also needs to register with the server 130 first, so as to obtain the exclusive certificate from the server 130 . The management device 120 uploads the electronic list based on the exclusive certificate. By using the exclusive certificate as the identity basis of the management terminal device 120, only the management terminal device 120 can upload the electronic list to the server 130.

After receiving the electronic list, the server 130 will associate the electronic list with the virtual card used to log in the interactive interface this time, and generate a payment notification corresponding to the electronic list, and then send the payment notification to the user through the interactive interface End device 110. At this point, the client device 110 can obtain the payment notification through the interactive interface, and execute the corresponding payment action.

In step S215 , in response to the completion of the payment action, the electronic barcode corresponding to the electronic bill is obtained from the server 130 through the client device 110 .

In step S220 , the client device 110 transmits the electronic barcode to the store device 140 , so that the store device 140 obtains the electronic list from the server 130 based on the electronic barcode.

After obtaining the electronic barcode, the store device 140 connects to the server 130 to obtain an electronic list corresponding to the electronic barcode from the server 130 . The store terminal device 140 can further verify whether the obtained electronic list is accompanied by the exclusive certificate issued by the server 130, thereby judging whether the electronic list is valid. If the electronic list is accompanied by an exclusive certificate, it is determined that the electronic list is valid, that is, it is confirmed that the electronic list is uploaded by the management terminal device 120 . And after the store ships according to the electronic list, it can further change the shipping status of the electronic list by connecting to the server 130 through the store terminal device 140 .

The remote interactive system 100 and the method can be further applied to a telemedicine system. For example, the medical terminal device of a medical unit (ie, the management terminal device 120 ) needs to first register with the medical insurance server (ie, the server 130 ) authorized by its medical organization to obtain an exclusive certificate. The patient also needs to first register with the medical insurance server through his own client device 110 to obtain a virtual card. After that, use the virtual card to make online appointments and consultations, and use the equipment used by doctors and patients for diagnosis.

Another example will be given below for illustration. FIG. 3 is a block diagram of a telemedicine system according to an embodiment of the invention. The telemedicine system 300 of this embodiment is an application example of the teleinteraction system 100 . Please refer to FIG. 3 , the telemedicine system 300 includes a client device 31 , a medical device 32 , a medical insurance server 33 and a pharmacy device 34 , and the devices are connected and communicated through a network. Among them, the client device 31, the medical device 32, the medical insurance server 33 and the pharmacy device 34 respectively correspond to the client device 110, the management device 120, the server 130 and the store device in the remote interactive system 100. 140. The medical insurance server 33 is used to store patient information, medical treatment records, medication records, premium payment records, claims records, drug information, electronic prescription notes, and the like. The electronic prescription includes the patient's medical record (name, medical department, hospital, doctor, prescription drug issuance details, prescription drug information, medication frequency), prescription status (opened, payment completed, drug preparation , drug delivery, drug delivery) and associated electronic barcodes. Through the state control mechanism of electronic prescription paper, the problem of multiple receipts for one prescription can be avoided.

First, in step S305 , the patient connects to the interactive interface provided by the medical insurance server 33 through the client device 31 , and conducts remote consultation through the virtual card. After the doctor's diagnosis is completed, in step S310, an electronic prescription can be issued through the medical terminal device 32, and the electronic prescription can be uploaded to the database associated with the virtual card used for login in the medical insurance server 33. At this point, the status of the electronic prescription is "issued".

After the diagnosis is completed, in step S315 , the medical insurance server 33 sends a payment notification to the client device 31 associated with the virtual card. The patient can log in to the medical insurance server 33 through the APP installed on the client device 31 or connect to the webpage to perform payment. After the payment is completed, in step S320, the patient can obtain the two-dimensional barcode or one-dimensional barcode of the electronic prescription slip for this visit through the client device 31 . Here, the two-dimensional barcode is, for example, a quick response code (Quick Response Code, QRcode). At this point, the status of the electronic prescription is "payment completed".

In addition, after logging into the medical insurance server 33 through the client device 31, in addition to paying to obtain the two-dimensional barcode or one-dimensional barcode of the electronic prescription, you can also query drug-related information and health education information such as safe medication.

Next, in step S325 , the user end device 31 transmits the electronic barcode to the pharmacy end device 34 . After that, in step S330 , the pharmacy end device 34 downloads the electronic prescription form from the medical insurance server 33 based on the electronic barcode. After the pharmacy terminal device 34 confirms receipt of the electronic prescription, the status of the electronic prescription is "drug preparation".

In addition, it is also possible to further choose home delivery service or pick up at the store through the user terminal device 31 . And about picking up at the store, it can also be designated as the person picking up at the store or being picked up by an agent through the user terminal device 31 .

If the home delivery service is selected through the client device 31, the client device 31 can be connected to the pharmacy end device 34 through the network, and the electronic barcode and recipient information are sent to the pharmacy end device 34, so that the pharmacy end The device 34 enables assignment of home delivery jobs based on the recipient profile. If there are self-paid medicines, online payment (for example, transfer, digital payment, credit payment) is performed through the user terminal device 31 . After that, the pharmacy personnel will send the medicine to the address specified by the patient, and the status of the electronic prescription will be "drug distribution". After the patient receives the medicine, the status of the electronic prescription is "Drug Receiving Completed".

If you choose to pick it up at the store through the client device 31 (you can designate yourself to pick it up at the store or designate an agent to pick it up at the store), then when the patient or agent arrives at the pharmacy, they must first show their photo ID or physical card Or capture facial photos through the imaging device (such as a camera) of the pharmacy, and then connect to the medical insurance server 33 through the pharmacy end device 34 to perform feature recognition and judgment, thereby performing identity authentication to prove that it is a patient in person or as an agent. Then, the card reader provided by the pharmacy terminal device 34 can be used to read the patient's physical card (the virtual card associated with the patient himself) to connect (login) to the medical insurance server 33 to obtain the electronic prescription. Alternatively, the client device 110 presents the two-dimensional barcode or one-dimensional barcode for scanning by the scanner of the medicine local device 34 to connect (login) to the medical insurance server 33 to obtain the electronic prescription. Or, after choosing to go to the store to pick up through the client device 31, the electronic barcode can be transmitted to the pharmacy end device 34 through the user end device 31 before receiving, so that the pharmacy end device 34 can prepare medicine in advance. Drug stock control can also help.

After the pharmacy personnel pack the medicines, they will hand over the prescription medicines to the patients. Then, the staff of the pharmacy connects to the medical insurance server 33 through the pharmacy end device 34 to claim the pharmacist's service fee. At this time, the status of the electronic prescription is "completion of receiving medicine".

In addition, after receiving the electronic prescription, the pharmacy end device 34 can further verify the electronic prescription. For example, the pharmacy terminal device 34 verifies whether the electronic list is accompanied by a dedicated certificate, thereby judging whether the electronic list is valid. Moreover, the authenticity of the electronic prescription can also be judged for the second time through the rationality judgment model. The rationality determination model, for example, is obtained by using deep learning or machine learning to train, and can use registered hospitals/clinics, physicians, departments, frequency of visits, frequency of changing departments, drug details, date and time of visits , medicine collection mode (self-pickup or home delivery) and other medical records for training, and then obtain a rationality judgment model. The rationality judgment model can help the pharmacist check, that is, when there is doubt about the rationality of the electronic prescription, the rationality judgment model will pop up a warning signal to notify the pharmacist, and the pharmacist can perform a second confirmation at this time, for example, he can issue the electronic prescription with The hospital or doctor who wrote the prescription will confirm the information, so as to avoid the counterfeiting of the electronic prescription certificate and pass the verification, which will lead to drug abuse.

To sum up, the present invention uses virtual cards to conduct online meetings, and obtains the 2D barcode or 1D barcode of the electronic list associated with the virtual card, and then provides the 2D barcode or 1D barcode to the store terminal device. Carry out the pick-up action. Accordingly, remote interaction can be used to provide more convenient consultation methods, and two-dimensional barcodes or one-dimensional barcodes can be used to pick up or deliver goods. Through the drug home delivery logistics mechanism, the probability of contact with the masses can be greatly reduced, so as to achieve Reduce the risk of infection and solve the problem of infection caused by patients and their families or their agents entering and leaving the hospital.

100: Remote Interactive System 110, 31: client device 120: Management device 130: server 140: Store end device 150: Network 300:Telemedicine system 32:Medical device 33:Medical insurance server 34: Central office device S205～S220: Steps of remote interaction method S305～S330: Steps of remote consultation method

FIG. 1 is a block diagram of a remote interactive system according to an embodiment of the present invention. FIG. 2 is a flowchart of a remote interaction method according to an embodiment of the invention. FIG. 3 is a block diagram of a telemedicine system according to an embodiment of the invention.

S205~S220: Steps of the remote interaction method

Claims (10)

A method of remote interaction comprising: Using a virtual card to log in to an interactive interface provided by a server through a client device, so as to conduct an online meeting with a management device through the interactive interface; After the online meeting is over, obtain a payment notification from the interactive interface through the client device, and perform a payment action; Responsive to completing the payment action, obtaining an electronic barcode corresponding to an electronic bill from the server through the client device; and The electronic barcode is sent to a store-end device through the client-end device, so that the store-end device obtains the electronic list from the server based on the electronic barcode. The remote interaction method as described in claim 1, wherein after the online meeting is over, it further includes: Upload the electronic list to the server through the management device; and Associate the electronic list with the virtual card through the server, and generate the payment notification corresponding to the electronic list. The remote interaction method described in claim 2, before uploading the electronic list to the server through the management device, further includes: Connect to the server to register through the management terminal device, so as to obtain a unique certificate from the server; and uploading the electronic list to the server through the management terminal device based on the exclusive certificate. The remote interaction method as described in claim 1, after sending the electronic barcode to the store device through the client device, it further includes: Connecting to the server through the store device, so as to obtain the electronic list corresponding to the electronic barcode from the server; and A shipment status of the electronic list is changed by connecting the store end device to the server. The remote interaction method as described in claim 4, after connecting to the server through the store-end device to obtain the electronic list corresponding to the electronic barcode from the server, further includes: Verifying whether the electronic list is accompanied by an exclusive certificate through the store terminal device, thereby judging whether the electronic list is valid. The remote interaction method as described in claim 1, before using the virtual card to log in to the interactive interface provided by the server through the client device, it further includes: The client device is connected to the server for registration, so that the server issues the virtual card to the client device. The remote interaction method as described in claim item 6, wherein the steps of connecting to the server to register through the client device include: sending a first verification code to the client device through the server, and when receiving a response from the client device within a specified time period, verifying whether the response matches the first verification code; sending a user information and a second verification code to the server through the client device; and Verifying whether the second verification code is valid through the server, so that when the response matches the first verification code and the second verification code is determined to be valid, issue the virtual card to the client device through the server. The remote interaction method as described in claim item 7, wherein during the period of registering with the server through the client device, it further includes: uploading a facial image and a device authentication code to the server through the client device, so that the server determines the client device uploading the facial image through the authentication code; When the response matches the first verification code and the second verification code is valid, extract a facial feature from the facial image through the server and issue the virtual card to the client after storing the facial feature device; and The facial image is associated with the virtual card through the server. The remote interaction method as described in claim 1 further includes: In response to a pick-up at the store selected through the client device, in the store-side device, a facial image is captured through an imaging device for identity authentication, and after passing the identity authentication, including: Read a physical card through a card reader to connect to the server to obtain the electronic list, wherein the physical card is associated with the virtual card; or scanning the electronic barcode displayed on the client device through a scanner to connect to the server to obtain the electronic list; In response to selecting a home delivery service through the client device, sending a recipient information to the shop device through the client device, so that the shop device can assign a home delivery job based on the recipient information. A remote interactive system comprising: a client device; a management device; a shop-side device; and a server providing an interactive interface, Wherein the client device, the management device, the store device and the server are connected through the network, The client device uses a virtual card to log in to the interactive interface, so as to conduct an online meeting with the management device through the interactive interface; After the online meeting ends, the client device obtains a payment notification from the interactive interface, and executes a payment action; In response to completing the payment action, the client device obtains an electronic barcode corresponding to an electronic bill from the server; The user end device transmits the electronic barcode to a store end device, so that the store end device obtains the electronic list from the server based on the electronic barcode.

Images