CN117492616A - Interaction method and system for counter service - Google Patents

Interaction method and system for counter service Download PDF

Info

Publication number
CN117492616A
CN117492616A CN202311555475.2A CN202311555475A CN117492616A CN 117492616 A CN117492616 A CN 117492616A CN 202311555475 A CN202311555475 A CN 202311555475A CN 117492616 A CN117492616 A CN 117492616A
Authority
CN
China
Prior art keywords
person
old
elderly
information
accompanying
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311555475.2A
Other languages
Chinese (zh)
Inventor
李宽
张海燕
李振
高强裔
王湃涵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing National Financial Technology Certification Center Co ltd
Original Assignee
Beijing National Financial Technology Certification Center Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing National Financial Technology Certification Center Co ltd filed Critical Beijing National Financial Technology Certification Center Co ltd
Priority to CN202311555475.2A priority Critical patent/CN117492616A/en
Publication of CN117492616A publication Critical patent/CN117492616A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/01Customer relationship services
    • G06Q30/015Providing customer assistance, e.g. assisting a customer within a business location or via helpdesk
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/26Government or public services

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Computer Security & Cryptography (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Educational Administration (AREA)
  • Accounting & Taxation (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Primary Health Care (AREA)
  • Finance (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

The embodiment of the application provides an interaction method and system for counter service. Acquiring the type of a user using the counter service; if the type of the user is the old people, the identity information of the accompanying person accompanying the old people is confirmed; determining the operation authority of the companion based on the identity information of the companion and the authorization information of the elderly; outputting operation information to the elderly and sharing the operation information to the accompanying person; triggering an operation interface of the next step based on the confirmation of the operation information by the accompanying person and the confirmation of the operation information by the old person; if the writing bars exist in the next operation interface, the writing bars are displayed in a differentiated mode and are used for the old to write, at the moment, the operation interface of the next step can be triggered only by double confirmation of the accompanying person and the old, safety of counter service for the old is guaranteed, and interaction effect of the counter service interaction method is improved.

Description

Interaction method and system for counter service
Technical Field
The application relates to the technical field of computers, in particular to a counter service interaction method and system.
Background
Along with development of science and technology, banks need to provide suitable services for the elderly, in the existing counter service, the elderly is generally in a window of counter service with the accompanying person at the same time, but in the existing technical scheme for providing counter service for the elderly, the accompanying person cannot play a role, the elderly cannot benefit in business handling due to accompanying of the elderly, and the elderly and the service person are left to perform independent places, so that the existing counter service interaction method cannot enable the accompanying person to learn the operation information of the elderly.
Disclosure of Invention
In view of the above, an object of the present application is to provide a method of counter service and a system for implementing the method, so as to add a partner's accompanying policy to the counter service of the elderly at least to some extent, and determine the operation authority of the partner based on the identity information of the partner and the authorization information of the elderly, so as to give the operation authority to the partner; when the operation information is output to the old people, the operation information is shared to the accompanying person, so that the accompanying person is ensured to learn the operation information of the old people, and the old people can be reasonably guided to operate; under the condition, the operation interface of the next step is triggered based on the confirmation of the operation information by the accompanying person and the confirmation of the operation information by the old person, so that the operation interface of the next step can be triggered only by the double confirmation of the accompanying person and the old person when needed, the convenience and the safety of counter service for the old person are improved, meanwhile, writing bars are displayed in a differentiated mode, the old person is provided for writing, and the interaction effect of the interaction method of the counter service is improved.
Other features and advantages of the present application will be apparent from the following detailed description, or may be learned by the practice of the application in part.
According to an aspect of an embodiment of the present application, there is provided an interaction method for a counter service, including:
acquiring the type of a user using the counter service;
if the type of the user is the old people, the identity information of the accompanying person accompanying the old people is confirmed;
determining the operation authority of the companion based on the identity information of the companion and the authorization information of the elderly;
outputting operation information to the elderly and sharing the operation information to the accompanying person;
triggering an operation interface of the next step based on the confirmation of the operation information by the accompanying person and the confirmation of the operation information by the old person;
if the writing bar exists in the operation interface in the next step, the writing bar is displayed in a differentiated mode and is used for the old to write.
Optionally, the acquiring the type of the user using the counter service includes:
receiving a user image shot by a camera;
the type of user using the counter service is determined from the user image.
Optionally, if the type of the user is an elderly person, the step of confirming identity information of a companion person accompanying the elderly person includes:
acquiring a user image;
based on the texture area of the face region in the user image;
if the texture area reaches a preset texture area threshold value, the type of the user is the old;
When the type of the user is the old people, acquiring an image of a companion person accompanying the old people;
determining a biometric characteristic of a companion person who accompanies the elderly person based on the image of the companion person;
and determining identity information of the accompanying person for the elderly according to the biological characteristics of the accompanying person.
Optionally, the determining the operation authority of the companion based on the identity information of the companion and the authorization information of the elderly includes:
acquiring authorization information of the elderly;
resolving the authorization information of the old people and determining the authorization association person;
identity matching is carried out on the basis of the identity information of the authorized associated person and the identity information of the accompanying person;
if the identity information of the authorized associated person is matched with the identity information of the accompanying person, determining that the accompanying person is an authorized person of the old person, and giving the accompanying person operation permission, wherein the accompanying person operation permission is the operation permission allowed by the old person.
Optionally, the outputting the operation information to the elderly and sharing the operation information to the co-person includes:
acquiring an operation interface of the old;
outputting operation information based on an operation of the elderly with respect to the operation interface;
associating the operation interface with a display interface of a head-mounted device worn by the companion;
Sharing the operation interface to the accompanying person, and viewing the operation information on the display interface.
Optionally, the step of triggering the operation interface based on the operation information confirmation by the accompanying person and the operation information confirmation by the elderly includes:
the method comprises the steps of obtaining the processing of the operation information by the old and obtaining the confirmation of the operation information by the old;
transmitting the confirmation of the operation information to a display interface of the head-mounted equipment worn by the accompanying person based on the confirmation of the old person, and triggering the operation of the accompanying person;
further confirming the operation information based on the operation of the companion;
and carrying out double confirmation on the basis of the confirmation of the operation information by the accompany person and the confirmation of the operation information by the old person, and triggering the operation interface of the next step.
Optionally, if the writing bar exists in the operation interface in the next step, the writing bar is displayed in a differentiated mode and is used for the old to write, and the method further includes:
acquiring an operation interface of the next step;
traversing the operation interface of the next step, or determining a writing bar in a direct positioning mode;
marking the area of the writing bar;
and carrying out differential display on the area of the writing bar so as to be written by the old.
Optionally, the interaction method of the counter service further includes:
Acquiring a mobile phone interface of an elderly person, namely establishing a mechanism for pushing information to the mobile phone of the elderly person and receiving operation feedback of the information;
synchronizing an interface operated by the elderly to a mobile phone interface of a companion of the elderly, and storing content operated by the elderly, wherein the content operated by the elderly is subjected to abstract processing, namely abstract calculation and storage;
the content operated by the aged is checked based on the mobile phone interface of the aged and auxiliary information can be sent to the mobile phone interface of the aged to assist in a remote way.
Optionally, the interaction method of the counter service further includes:
acquiring sentences of the old;
determining a language style based on the sentence of the elderly;
based on the conversion of language style, determining to convert the sentence of the old into the sentence of the mandarin, and presenting the sentence on a counter interface;
or, acquiring the sign language of the old;
performing text conversion based on the sign language of the old and presenting the converted text on a counter interface;
interaction between the counter and the elderly is performed based on sign language actions.
According to an embodiment of the present application, a counter service interaction system can be implemented, and the counter service interaction method is applied to the above, and includes:
The acquisition module is used for acquiring the type of the user using the counter service;
the confirmation module is used for confirming the identity information of the accompanying person accompanying the old people if the type of the user is the old people;
the permission module is used for determining the operation permission of the companion based on the identity information of the companion and the authorization information of the old;
the sharing module is used for outputting the operation information to the old people and sharing the operation information to the accompanying person;
the prompting module is used for providing a prompt for the aged person how to assist the aged person when the operation information of the aged person is shared to the aged person;
the interface module is used for triggering the operation interface of the next step based on the confirmation of the operation information by the accompanying person and the confirmation of the operation information by the old;
and the handwriting prompting module is used for displaying the writing bars in a differentiated mode if the writing bars exist in the operation interface of the next step and writing by the old.
According to one embodiment of the present application, a storage medium has stored thereon a computer program which, when executed by a processor, implements the interaction method of a counter service as claimed in any one of claims 1 to 7.
According to one embodiment of the present application, an electronic device includes:
One or more processors;
and a storage device for storing one or more programs that, when executed by the one or more processors, cause the one or more processors to implement the interaction method of the counter service as described in the previous embodiments.
In the technical scheme provided by some embodiments of the present application, the accompanying policy of the accompanying person is added to the counter service of the elderly person, the operation authority of the accompanying person is determined based on the identity information of the accompanying person and the authorization information of the elderly person, so that the operation authority of the accompanying person is given, the operation information is output to the elderly person, the operation information is shared to the accompanying person, the learning of the operation information of the elderly person by the accompanying person is guaranteed, the elderly person can be reasonably guided to operate, at this time, the next operation interface is triggered based on the confirmation of the operation information by the accompanying person and the confirmation of the operation information by the elderly person, so that the next operation interface can be triggered by the double confirmation of the accompanying person and the elderly person when needed, the convenience and the safety of the counter service of the elderly person are improved, meanwhile, the writing bar is differentially displayed, and the interactive effect of the interactive method of the counter service is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application. It is apparent that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained from these drawings without inventive effort for a person of ordinary skill in the art. In the drawings:
FIG. 1 illustrates a flow diagram of an interaction method for a counter service according to one embodiment of the present application;
FIG. 2 shows a schematic flow chart of S120 in FIG. 1;
FIG. 3 shows a schematic flow chart of S130 in FIG. 1;
fig. 4 shows a schematic flow chart of S140 in fig. 1;
FIG. 5 shows a schematic flow chart of S150 in FIG. 1;
fig. 6 shows a schematic flow chart of S160 in fig. 1;
FIG. 7 illustrates a block diagram of an interactive system for a counter service according to one embodiment of the present application;
fig. 8 shows a schematic diagram of a computer system suitable for use in implementing the electronic device of the embodiments of the present application.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the present application. One skilled in the relevant art will recognize, however, that the aspects of the application can be practiced without one or more of the specific details, or with other methods, components, devices, steps, etc. In other instances, well-known methods, systems, implementations, or operations have not been shown or described in detail to avoid obscuring aspects of the application.
The block diagrams depicted in the figures are merely functional entities and do not necessarily correspond to physically separate entities. That is, the functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
The flow diagrams depicted in the figures are exemplary only, and do not necessarily include all of the elements and operations/steps, nor must they be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be synthesized or partially synthesized, so that the order of actual execution may be changed according to actual situations.
Fig. 1 shows a flow diagram of an interaction method of a counter service according to one embodiment of the present application. The method can be applied to a counter of a bank.
Referring to fig. 1 to 8, the interaction method of the counter service at least includes steps S110 to S160, and the following details are described (the following description uses the method as an example of the counter service for the elderly):
in step S110, the type of the user who uses the counter service is acquired.
In an embodiment of the application, receiving a user image taken by a camera; the type of the user using the counter service is determined according to the user image, and at this time, if the user arrives at the bank counter, the bank counter provides counter service for the user and performs specific counter service for different types of the user so as to perform customized service for the elderly.
The method comprises the following specific steps: when the old person user enters a banking website to take a number, the banking website sends out an identification signal for the old person, and the banking system starts user type identification processing on information captured by a camera of a hall to determine the type of the user using counter service.
The identification signal of the old people can be triggered by a camera of the number taking machine when the old people take numbers, and can also be triggered by hall staff; after triggering, the video and audio data which is only used for security monitoring and archiving originally is transmitted to a special user identification subsystem, and the result of the identification of the user identification subsystem is used for judging whether the served client is the old.
The equipment of different camera devices at banking sites may cause different modes of acquiring images, and when the device can capture dynamic images and the captured images can meet the requirements of recognition use, the recognition process may be insensitive to the elderly; when the device can only process still images, the acquired user image may need to be a front image, so that the face of the user is clearly highlighted, and the outer outline in the user image is highlighted, so that the face image is conveniently identified, the identification of an irrelevant area is avoided, the influence of the irrelevant area is reduced, and the old people are required to cooperate at the moment.
Alternatively, when customers who look visually other than elderly people actively claim such services, banking outlets may then directly serve the identified elderly people.
In step S120, if the type of the user is the elderly, the identity information of the co-person accompanying the elderly is confirmed.
In the embodiment of the application, the type of the user is the old person, and the identity of the accompanying person for the old person is confirmed, so that the old person and the accompanying person are related, and the accompanying person and the old person are guaranteed to be served as a whole by the counter.
The method comprises the following specific steps:
step S121, obtaining a user image;
in an embodiment of the present application, to obtain a clear image for identification, the first head-mounted device is worn on the elderly person to obtain a field of view of the elderly person.
In addition, the first head-mounted device is aimed at carrying out vision adjustment on the old people, wherein the vision adjustment comprises automatic adjustment, manual auxiliary adjustment or manual adjustment, so that the focal length of the first head-mounted device is adjusted according to the vision condition of the old people, and the first head-mounted device is convenient for the old people to wear and make the front vision clear for the old people, and the follow-up old people can watch the front vision.
Step S122, based on the texture area of the face area in the user image;
in the embodiment of the application, the user image is divided into a neck region, a face region and a peripheral region so as to form various regions, and the face region is focused on in the embodiment of the application, and the face region is scanned and analyzed by contour lines so as to determine texture features in the face region and further determine the texture area of the face region in the user image.
Step S123, if the texture area reaches a preset texture area threshold value, judging that the type of the user is old people;
in the embodiment of the application, the texture area is compared with the preset texture area threshold value, so that the user type is determined by comparing the texture area with the preset texture area threshold value, at this time, if the texture area reaches the preset texture area threshold value, the type of the user is judged to be the old person, so that the service mechanism of the corresponding old person is triggered, and the suitability of counter service for different user types is realized.
Step S124, when the type of the user is the old person, an image of the accompanying person accompanying the old person is acquired.
Step S125, determining the biological characteristics of the companion person based on the image of the companion person accompanying the elderly person.
Step S126, the identity information of the accompanying person of the elderly is determined according to the biological characteristics of the accompanying person.
In the embodiment of the application, when the type of the user is the elderly, the counter service performs corresponding interaction service for the elderly, and obtains the surrounding environment of the elderly to determine whether a companion exists in the surrounding environment of the elderly, and if the companion exists in the surrounding environment of the elderly, obtains the image of the companion of the elderly, so as to perform subsequent identity authentication, such as citizen identity number authentication, authentication code authentication, and the like, through the image of the companion of the elderly.
At this time, the biological characteristics of the accompanying person are determined based on the images of the accompanying person of the elderly, and the identity information of the accompanying person of the elderly is determined according to the biological characteristics of the accompanying person, so that the relationship between the accompanying person and the elderly is determined while the identity is authenticated, the authority is further processed, and the application scene of the accompanying person for assisting the elderly is realized.
Referring to fig. 3, in step S130, the operation authority of the companion is determined based on the identity information of the companion and the authorization information of the senior citizen.
In the embodiment of the application, the identity information of the accompanying person and the authorization information of the old person are acquired, whether the accompanying person is located in the authorized crowd of the old person or not is determined through the comparison between the identity information of the accompanying person and the authorization information of the old person, if the accompanying person is located in the authorized crowd of the old person, the operation authority of the accompanying person is given to the accompanying person, so that the accompanying person can assist the old person in operation, and the old person is assisted in completing subsequent operation, and the availability and safety of the old person operation are improved.
The method comprises the following specific steps:
step S131, obtaining authorization information of the elderly.
Step S132, analyzing the authorization information of the elderly, and determining the authorized associated person.
In the embodiment of the application, the authorization information of the elderly is obtained, the authorization information of the elderly can be an authorization crowd preset in the middle-aged and elderly of a bank, and the identity information of the authorization crowd is used as information for comparison so as to determine the authorization related person.
Step S133, identity matching is carried out on the basis of the identity information of the authorized associated person and the identity information of the accompanying person.
Step S134, if the identity information of the authorized associated person is matched with the identity information of the accompanying person, determining that the accompanying person is an authorized person of the elderly person, and giving the operation authority of the accompanying person, wherein the operation authority of the accompanying person is the operation authority allowed by the elderly person.
In the embodiment of the application, identity matching is performed between the identity information of the authorized associated person and the identity information of the accompanying person based on the identity information of the authorized associated person so as to perform the identity matching on the authorized associated person and the accompanying person, and therefore whether the identity of the accompanying person is in a list of authorized associated persons or not is determined.
If the identity information of the authorized associated person is matched with the identity information of the accompanying person, the identity of the accompanying person is in a list of the authorized associated person, the accompanying person is determined to be an authorized person of the old person, and the corresponding operation authority is given to the accompanying person so as to observe and assist the operation of the old person and record communication with a bank counter service person.
Referring to fig. 4, in step S140, operation information is output to the elderly and shared to the companion.
In the embodiment of the application, the first head-mounted device is worn on the old person, the second head-mounted device is worn on the accompanying person, the second head-mounted device is associated with the first head-mounted device, signal synchronous transmission is carried out between the second head-mounted device and the first head-mounted device, auxiliary guide information sent by the system can be accepted, and therefore the accompanying person can determine the scene of optical and digital superposition seen by the old person based on the signal synchronous transmission between the second head-mounted device and the first head-mounted device, and service handling of the old person can be effectively assisted.
The method comprises the following specific steps:
step S141, acquiring an operation interface of the old;
step S142, outputting operation information based on the operation of the elderly person relative to the operation interface;
in the embodiment of the application, the elderly transacting banking while wearing the first head-mounted device, at this time, the elderly observes the outside world through the first head-mounted device, wherein the digital information is mainly used for marking, highlighting real objects seen in the field of view of the elderly, and performing image confirmation on objective objects in the field of view of the elderly, so as to determine auxiliary support information that should or can be provided.
Step S143, associating the operation interface with a display interface of the head-mounted device worn by the companion;
when the old person operates relative to the operation interface, operation information is output based on the operation of the old person relative to the operation interface, and the information received by the operation interface is synchronously transmitted to the second head-mounted device, so that the acquisition and assistance of the cosign based on the second head-mounted device to the information received by the operation interface are ensured, and the safety and rationality of the old person in using the counter service are further ensured.
Step S144, sharing the operation interface to the companion, and viewing the operation information on the display interface.
In the embodiment of the application, the operation terminal corresponding to the operation interface is in signal association with the head-mounted device worn by the accompanying person, so that the operation terminal corresponding to the operation interface is associated with the second head-mounted device, the second head-mounted device receives the operation information output by the operation terminal corresponding to the operation interface, shares the operation interface to the accompanying person, and checks the operation information on the display interface, thereby further controlling the operation information and ensuring the accuracy of the operation information.
Referring to fig. 5, in step S150, the operation interface of the next step is triggered based on the confirmation of the operation information by the companion and the confirmation of the operation information by the elderly.
In the embodiment of the application, the accompanying policy of the accompanying person is added for the counter service of the old person, the operation authority of the accompanying person is determined based on the identity information of the accompanying person and the authorization information of the old person so as to give the operation authority of the accompanying person, the operation information is output to the old person and shared to the accompanying person, the learning of the operation information of the old person by the accompanying person is guaranteed, the old person can be reasonably guided to operate, at this time, the next operation interface is triggered based on the confirmation of the operation information by the accompanying person and the confirmation of the operation information by the old person so that the next operation interface can be triggered only by the double confirmation of the accompanying person and the old person, and the safety of the counter service for the old person is guaranteed.
The method comprises the following specific steps:
step S151, the old people process the operation information and the old people confirm the operation information.
Step S152, based on the confirmation of the old people on the operation information, the operation information is synchronously transmitted to a display interface of the head-mounted equipment worn by the companion, and the operation of the companion is triggered;
step S153, further confirming the operation information based on the operation of the companion;
step S154, double confirmation is carried out on the basis of the confirmation of the operation information by the accompany person and the confirmation of the operation information by the old person, and the operation interface of the next step is triggered.
In the embodiment of the application, the processing of the operation information by the elderly person is obtained, including obtaining the confirmation of the operation information by the elderly person, and the confirmation of the operation information by the elderly person needs to be further determined by the companion person, so that after the confirmation of the operation information by the elderly person is not a final confirmation result, the confirmation of the operation information by the elderly person needs to be checked by the companion person, and the operation of the companion person needs to be obtained.
Further, based on the fact that the old person confirms the operation information and synchronously transmits the operation information to a display interface of the head-mounted device worn by the accompanying person, operation of the accompanying person is triggered, so that the old person confirms the operation information and is switched to the accompanying person, the accompanying person confirms the operation information further, the old person confirms the operation information to be checked again, safety processing is conducted on the old person confirms the operation information, and at the moment, double confirmation is conducted on the basis of the fact that the accompanying person confirms the operation information and the old person confirms the operation information, and the operation interface of the next step is triggered.
Referring to fig. 6, in step S160, if a writing bar exists in the operation interface of the next step, the writing bar is displayed in a differentiated manner, and is written by the elderly.
In the embodiment of the application, the writing bars are displayed in a differentiated mode and are used for the old to write, so that the interaction effect of the interaction method of the counter service is improved, the attention of the old to the writing bars is ensured, the writing of the old is ensured, and writing is prevented from being out of a writing area.
The method comprises the following specific steps:
step S161, acquiring an operation interface of the next step;
step S162, traversing the operation interface of the next step and determining a writing column;
step S163, marking the area of the writing column;
step S164, the area of the writing bar is displayed in a differentiated mode so that the writing bar can be written by the old.
In the embodiment of the application, the next operation interface is acquired, and the next operation interface needs to be presented after the operation information is confirmed by the accompanying person and the operation information is confirmed by the old person, and meanwhile, the next operation interface is traversed so as to be convenient for checking the area of the operation interface, so that a writing column of the operation interface is searched, and the signature area of the old person is convenient to confirm.
At this time, the area of the writing bar is marked, and other areas are blurred; the area of writing column is displayed in a differentiated mode for the old to write, so that the identification degree of the old to the writing column is improved, writing is avoided to be outside the writing area, the writing column is signed by the old, and the accompany can not sign due to poor visibility.
In another embodiment of the present application, only a headset that has been previously security authenticated (e.g., a headset number registered in the system, encrypted and signed using a special APP, or even all information via digital certificates) can be used as the remote second cradle;
when a customer proposes to use the first head-mounted device for recording, a summary can be calculated on the recorded information, so that the authenticity of the recorded information is ensured; when a client speaks a dialect, under the condition of having a condition, the dialect spoken by the client can be translated into Mandarin and is transferred to a display screen, and meanwhile, a teller can read the translated and transferred information through corresponding equipment;
when a customer needs to write, the position needing to write can be displayed through superposition of the optical lens and the display screen; when the customer is required to fill in the amount, the filled-in content can be read through the camera equipment and checked with the customer through the oral head; for example, when the identification card number is filled in the finance column, the teller and the customer can be explicitly prompted; for the elderly who can understand but have difficult language expression, the information can be heard through headphones and conversations, and the information can be replied through writing (including paper and electronic modes).
In addition, for the old people who can use the sign language, the camera can confirm the sign language, convert the sign language into related characters through AI or manual transcription, convert the reply of the teller into the sign language and display the sign language on a display screen.
The old people with poor flexibility of the hands can give the maximum space capable of writing according to the preset setting and display the maximum space on the screen, so that the customers can write more easily; for the old people with poor memory, the prior setting can provide the process text and video records of the last transaction at the banking website so as to clarify the historical transaction; for the elderly people needing the assistance of the accompanying person, the system can record the complete business handling and assistance process of the elderly people.
In another embodiment of the present application, the interaction method of the counter service further includes: establishing a push information receiving mechanism in a mobile phone of a partner of the old; pushing the visual field content operated by the old to a mobile phone interface of a partner of the old, and storing the content operated by the old, wherein the content operated by the old is subjected to abstract processing; and viewing the content operated by the aged based on the mobile phone interface of the companion of the aged, and performing remote assistance.
In another embodiment of the present application, a statement of an elderly person is obtained by a first head mounted device; determining a language style based on the sentence of the elderly; based on the conversion of language style, determining to convert the sentence of the old into the sentence of the mandarin, and presenting the sentence on a counter interface; or, acquiring the sign language of the old; performing text conversion based on the sign language of the old and presenting the converted text on a counter interface; interaction between the counter and the elderly is performed based on sign language actions.
According to the technical scheme provided by the embodiments of the application, the accompanying strategy of the accompanying person is added for the counter service of the elderly, the operation authority of the accompanying person is determined based on the identity information of the accompanying person and the authorization information of the elderly, the operation authority of the accompanying person is given to the elderly, the operation information is output to the elderly, the operation information is shared to the accompanying person, the learning of the operation information of the elderly by the accompanying person is guaranteed, the elderly can be reasonably guided to operate, at this time, the next operation interface can be triggered based on the confirmation of the operation information by the accompanying person and the confirmation of the operation information by the elderly, so that the next operation interface can be triggered through the double confirmation of the accompanying person and the elderly, the safety of the counter service of the elderly is guaranteed, meanwhile, the writing bars are differentially displayed, the elderly can write, and the interactive effect of the interactive method of the service is improved.
The elderly people are not limited to persons of specific ages, and all persons having the characteristics of the application in terms of body and spirit are considered as the elderly people; the companion of the application, the person who is likely to be the elderly, has the ability to assist the elderly. The counter service can be a fixed counter in a fixed place or a mobile service vehicle.
The following describes embodiments of a system of the present application that may be used to perform the interaction method of the counter service in the above-described embodiments of the present application. For details not disclosed in the embodiments of the apparatus of the present application, please refer to the embodiments of the interaction method of the counter service described in the present application.
FIG. 7 illustrates a block diagram of an interactive system for a counter service according to one embodiment of the present application.
Referring to fig. 7, an interactive system for a counter service according to an embodiment of the present application includes:
an acquisition module 210 for acquiring a type of a user using the counter service;
a confirmation module 220, configured to confirm identity information of a partner accompanying the elderly if the type of the user is the elderly;
an authority module 230 for determining an operation authority of the companion based on the identity information of the companion and the authorization information of the elderly;
The sharing module 240 is configured to output operation information to the elderly and share the operation information to the companion;
the interface module 250 is configured to trigger the operation interface of the next step based on the confirmation of the operation information by the companion and the confirmation of the operation information by the elderly;
the signature module 260 is configured to display the writing bar differently and provide the writing bar for the elderly if the writing bar exists in the operation interface of the next step;
the prompt module 270 is configured to provide a prompt for the elderly person on how to assist the elderly person when sharing the operation information of the elderly person to the companion person.
In one embodiment of the present application, there is also provided an electronic device including:
one or more processors;
and a storage device for storing one or more programs that, when executed by the one or more processors, cause the one or more processors to implement the interaction method of the counter service as described in the previous embodiments.
In one example, FIG. 8 illustrates a schematic diagram of a computer system suitable for use in implementing the electronic device of the embodiments of the present application.
It should be noted that, the computer system of the electronic device shown in fig. 8 is only an example, and should not impose any limitation on the functions and the application scope of the embodiments of the present application.
As shown in fig. 8, the computer system includes a central processing unit (Central Processing Unit, CPU) 301 (i.e., a processor as described above) that can perform various appropriate actions and processes, such as performing the methods described in the above embodiments, according to a program stored in a Read-Only Memory (ROM) 302 or a program loaded from a storage section 308 into a random access Memory (Random Access Memory, RAM) 303. It should be understood that RAM303 and ROM302 are just described as storage devices. In the RAM303, various programs and data required for the system operation are also stored. The CPU 301, ROM302, and RAM303 are connected to each other through a bus 304. An Input/Output (I/O) interface 305 is also connected to bus 304.
The following components are connected to the I/O interface 305: an input section 306 including a keyboard, a mouse, and the like; an output portion 307 including a Cathode Ray Tube (CRT), a liquid crystal display (Liquid Crystal Display, LCD), and the like, a speaker, and the like; a storage section 308 including a hard disk or the like; and a communication section 309 including a network interface card such as a LAN (Local Area Network ) card, a modem, or the like. The communication section 309 performs communication processing via a network such as the internet. The drive 310 is also connected to the I/O interface 305 as needed. A removable medium 311 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed on the drive 310 as needed, so that a computer program read therefrom is installed into the storage section 308 as needed.
In particular, according to embodiments of the present application, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a storage medium, the computer program comprising a computer program for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 309, and/or installed from the removable medium 311. When executed by a Central Processing Unit (CPU) 301, performs the various functions defined in the system of the present application.
It should be noted that, the storage medium shown in the embodiments of the present application may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-Only Memory (ROM), an erasable programmable read-Only Memory (Erasable Programmable Read Only Memory, EPROM), flash Memory, an optical fiber, a portable compact disc read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
In the present application, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with a computer-readable computer program embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any storage medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. The computer program embodied on the storage medium may be transmitted synchronously with any suitable medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. Where each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present application may be implemented by means of software, or may be implemented by means of hardware, and the described units may also be provided in a processor. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.
As another aspect, the present application also provides a storage medium that may be included in the electronic device described in the above embodiment; or may exist alone without being incorporated into the electronic device. The storage medium carries one or more programs which, when executed by one of the electronic devices, cause the electronic device to implement the methods described in the above embodiments.
It should be noted that although in the above detailed description several modules or units of a device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functions of two or more modules or units described above may be embodied in one module or unit, in accordance with embodiments of the present application. Conversely, the features and functions of one module or unit described above may be further divided into a plurality of modules or units to be embodied.
From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or may be implemented in software in combination with the necessary hardware. Thus, the technical solution according to the embodiments of the present application may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a usb disk, a mobile hard disk, etc.) or on a network, and includes several instructions to cause a computing device (may be a personal computer, a server, a touch terminal, or a network device, etc.) to perform the method according to the embodiments of the present application.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains.
It is to be understood that the present application is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims (9)

1. A method of interaction for a counter service, comprising:
acquiring the type of a user using the counter service;
if the type of the user is the old people, the identity information of the accompanying person accompanying the old people is confirmed;
determining the operation authority of the companion based on the identity information of the companion and the authorization information of the elderly; the step of determining the operation authority of the companion based on the identity information of the companion and the authorization information of the elderly comprises the following steps: acquiring authorization information of the elderly; resolving the authorization information of the old people and determining the authorization association person; identity matching is carried out on the basis of the identity information of the authorized associated person and the identity information of the accompanying person; if the identity information of the authorized associated person is matched with the identity information of the accompanying person, determining that the accompanying person is an authorized person of the old person, and giving the accompanying person operation permission, wherein the accompanying person operation permission is the operation permission allowed by the old person;
outputting operation information to the elderly and sharing the operation information to the accompanying person;
triggering an operation interface of the next step based on the confirmation of the operation information by the accompanying person and the confirmation of the operation information by the old person;
if the writing bar exists in the operation interface in the next step, the writing bar is displayed in a differentiated mode and is used for the old to write.
2. The method of claim 1, wherein the acquiring the type of user using the counter service comprises:
receiving a user image shot by a camera;
the type of user using the counter service is determined from the user image.
3. The method of claim 1, wherein if the type of the user is an elderly person, the identifying the identity information of the co-person accompanying the elderly person comprises:
acquiring a user image;
based on the texture area of the face region in the user image;
if the texture area reaches a preset texture area threshold value, the type of the user is the old;
when the type of the user is the old people, acquiring an image of a companion person accompanying the old people;
determining a biometric characteristic of a companion person who accompanies the elderly person based on the image of the companion person;
and determining identity information of the accompanying person for the elderly according to the biological characteristics of the accompanying person.
4. The method of claim 1, wherein outputting the operation information to the elderly and sharing the operation information to the co-mores comprises:
acquiring an operation interface of the old;
outputting operation information based on an operation of the elderly with respect to the operation interface;
Associating the operation interface with a display interface of a head-mounted device worn by the companion;
sharing the operation interface to the accompanying person, and viewing the operation information on the display interface.
5. The method of claim 4, wherein the triggering the next operation interface based on the confirmation of the operation information by the companion and the confirmation of the operation information by the elderly comprises:
the method comprises the steps of obtaining the processing of the operation information by the old and obtaining the confirmation of the operation information by the old;
transmitting the confirmation of the operation information to a display interface of the head-mounted equipment worn by the accompanying person based on the confirmation of the old person, and triggering the operation of the accompanying person;
further confirming the operation information based on the operation of the companion;
and carrying out double confirmation on the basis of the confirmation of the operation information by the accompany person and the confirmation of the operation information by the old person, and triggering the operation interface of the next step.
6. The method according to claim 5, wherein if the writing bar exists in the operation interface of the next step, the writing bar is displayed in a differentiated manner and is written by the elderly, and further comprising:
acquiring an operation interface of the next step;
traversing the operation interface of the next step and determining a writing column;
Marking the area of the writing bar;
and carrying out differential display on the area of the writing bar so as to be written by the old.
7. The method of claim 1, wherein the counter service interaction method further comprises:
acquiring a mobile phone interface of a companion of the old;
synchronizing an interface operated by the elderly to a mobile phone interface of a companion of the elderly, and storing content operated by the elderly, wherein the content operated by the elderly is subjected to abstract processing;
and viewing the content operated by the aged based on the mobile phone interface of the companion of the aged, and performing remote assistance.
8. The method of claim 1, wherein the counter service interaction method further comprises:
acquiring sentences of the old;
determining a language style based on the sentence of the elderly;
based on the conversion of language style, determining to convert the sentence of the old into the sentence of the mandarin, and presenting the sentence on a counter interface;
or, acquiring the sign language of the old;
performing text conversion based on the sign language of the old and presenting the converted text on a counter interface;
interaction between the counter and the elderly is performed based on sign language actions.
9. A counter service interaction system, characterized in that it is applied to the counter service interaction method of any one of claims 1 to 8, comprising:
The acquisition module is used for acquiring the type of the user using the counter service;
the confirmation module is used for confirming the identity information of the accompanying person accompanying the old people if the type of the user is the old people;
the permission module is used for determining the operation permission of the companion based on the identity information of the companion and the authorization information of the old; the step of determining the operation authority of the companion based on the identity information of the companion and the authorization information of the elderly comprises the following steps: acquiring authorization information of the elderly; resolving the authorization information of the old people and determining the authorization association person; identity matching is carried out on the basis of the identity information of the authorized associated person and the identity information of the accompanying person; if the identity information of the authorized associated person is matched with the identity information of the accompanying person, determining that the accompanying person is an authorized person of the old person, and giving the accompanying person operation permission, wherein the accompanying person operation permission is the operation permission allowed by the old person;
the sharing module is used for outputting the operation information to the old people and sharing the operation information to the accompanying person;
the interface module is used for triggering the operation interface of the next step based on the confirmation of the operation information by the accompanying person and the confirmation of the operation information by the old;
And the writing module is used for carrying out differential display on the writing bars and writing by the old people if the writing bars exist in the next operation interface.
CN202311555475.2A 2023-11-21 2023-11-21 Interaction method and system for counter service Pending CN117492616A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311555475.2A CN117492616A (en) 2023-11-21 2023-11-21 Interaction method and system for counter service

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311555475.2A CN117492616A (en) 2023-11-21 2023-11-21 Interaction method and system for counter service

Publications (1)

Publication Number Publication Date
CN117492616A true CN117492616A (en) 2024-02-02

Family

ID=89678053

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311555475.2A Pending CN117492616A (en) 2023-11-21 2023-11-21 Interaction method and system for counter service

Country Status (1)

Country Link
CN (1) CN117492616A (en)

Similar Documents

Publication Publication Date Title
US11310230B2 (en) System for electronic authentication with live user determination
US20210174069A1 (en) System for verifying the identity of a user
EP3053146B1 (en) Systems and methods for sharing verified identity documents
US20190019184A1 (en) Systems for Generating an Auditable Digital Certificate
US10339291B2 (en) Approving transactions using a captured biometric template
US20160232534A1 (en) Systems and Methods for Generating an Auditable Digital Certificate
US10387632B2 (en) System for provisioning and allowing secure access to a virtual credential
EP3385895A1 (en) Biometric information personal identity authenticating system and method using financial card information stored in mobile communication terminal
EP3887982B1 (en) Biometric authentication
US10108849B2 (en) Biometric facial recognition for accessing device and authorizing event processing
CA2884416C (en) Obtaining a signature from a remote user
EP3944109A1 (en) Information processing system, information processing method, and program
CN117492616A (en) Interaction method and system for counter service
US20230214838A1 (en) Dynamic Contactless Payment Based on Facial Recognition
JP6911886B2 (en) Electronics
US20190303558A1 (en) Enhanced Biometric Data and Systems for Processing Events Using Enhanced Biometric Data
JP2021196946A (en) Authentication system and authentication method
CA3129358A1 (en) Method for managing the access of a user to a voice service, corresponding device, system and programs
US10826899B2 (en) Enhanced biometric data and systems for processing events using enhanced biometric data
US11962706B2 (en) Hosting account linking services to enable dynamic authentication and multi-computer event processing
US20230252472A1 (en) Hosting Account Linking Services to Enable Dynamic Authentication and Device Selection
KR20210056622A (en) Apparatus, method, computer-readable storage medium and computer program for privacy and security enhancement
JP2023109134A (en) Method for managing identity verification information
CN114637982A (en) Transaction processing method, device, equipment and medium
CN116720862A (en) Method, device, equipment and storage medium for signing financial product protocol

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination