WO2024069460A1

WO2024069460A1 - Method and system for initiating service of a personalised workflow from a workflow application to a user

Info

Publication number: WO2024069460A1
Application number: PCT/IB2023/059588
Authority: WO
Inventors: George Bancs
Original assignee: Talk 5 Pty Ltd
Priority date: 2022-09-27
Filing date: 2023-09-27
Publication date: 2024-04-04

Abstract

A method, comprising storing user data relating to a user, storing workflow data relating to a workflow, providing a workflow application configured to serve a personalised workflow to the user based on the user data and the workflow data, in response to a trigger associated with the user or the workflow, initiating service of the personalised workflow from the workflow application to the user via a device accessible by the user.

Description

METHOD AND SYSTEM FOR INITIATING SERVICE OF A PERSONALISED WORKFLOW FROM A WORKFLOW APPLICATION TO A USER

Field

[0001 ] The present invention generally relates to a method and system for initiating service of a personalised workflow from a workflow application to a user.

Background

[0002] A workflow comprises a sequence of steps in an industrial, administrative, or other process through which a piece of work passes from initiation to completion. Workflows such as safety checklists are paper-based or digitised forms used by safety officers to inspect and identify workplace hazards that can cause potential harm to people, processes, and the environment.

[0003] Safety checklists are typically manually initiated, and then manually completed in paper-based or digitised forms. For example, in the construction industry, pre-start safety audits are manually initiated by a safety officer and completed each day before work starts at a worksite.

[0004] The present applicant has developed a workflow application with a unique voiceuser interface known as “Talk 5®” that presents or serves users personalised workflows, such as safety checklists and audits, using automatic text-to-voice and voice-to-text translation in their preferred or native language. The Talk 5® application is described in the present applicant’s WO 2020/053817 which is hereby incorporated by reference in its entirety.

[0005] The applicant has developed extensions and improvements to the Talk 5® application which are described in this application.

Summary

[0006] According to the present invention, there is provided a method, comprising: storing user data relating to a user; storing workflow data relating to a workflow to be completed by the user; providing a workflow application configured to serve a personalised workflow to the user based on the user data and the workflow data; in response to a trigger associated with the user or the workflow, initiating service of the personalised workflow from the workflow application to the user via a device accessible by the user.

[0007] The trigger may be presentation at an access card reader of an access card having a unique identifier (ID) associated with the user.

[0008] The access card may be an ID card, the unique ID may be a unique QR code printed on the ID card, and the access card reader may be an entry kiosk with a QR scanner.

[0009] When the user scans their ID card at the entry kiosk, the personalised workflow may be served to the user via the entry kiosk or a mobile device accessible by the user.

[0010] Alternatively, the trigger may be a location or a time associated with the user or the workflow, and the personalised workflow may be served to the user via a mobile device accessible by the user.

[0011 ] The workflow application may comprise a voice-user interface configured to serve the personalised workflow to the user as text-to-voice translation of the workflow data.

[0012] The user data may comprise user profile data selected from the group consisting of a preferred or native language of the user, a language literacy of the user, a level of expertise of the user, a level of experience of the user, an education level of the user, and qualifications of the user.

[0013] The workflow data may comprise data selected from the group consisting of steps in the workflow, a location of the workflow, a duration of the workflow, and a scheduled time for the workflow. [0014] The personalised workflow may comprise the text-to-voice translation of the workflow data in the user’s preferred or native language.

[0015] The workflow application may be further configured to perform voice-to-text translation of voice responses received from the user in their preferred or native language.

[0016] The workflow application may be further configured to store the voice-to-text translation of voice responses received from the user as workflow completion data.

[0017] The workflow application may be further configured to analyse the workflow completion data.

[0018] The workflow application may be further configured to generate an alert based on analysis the workflow completion data.

[0019] The workflow may be a checklist, a survey, a questionnaire, or an audit.

[0020] The present invention also provides a system, comprising a memory, and a processor configured by instructions stored in the memory to perform operations comprising: storing user data relating to a user; storing workflow data relating to a workflow to be completed by the user; providing a workflow application configured to serve a personalised workflow to the user based on the user data and the workflow data; in response to a trigger associated with the user or the workflow, initiating service of the personalised workflow from the workflow application to the user via a device accessible by the user.

[0021 ] The present invention further provides a computer system, comprising: a database storing personal information about a user, a workflow to be completed by the user, and a trigger event to present the workflow on a device of the user; and a workflow application configured to access the database to: generate a user-specific customized version of the workflow based on the personal information of the user; present the user-specific customized version of the workflow on the device of the user based on the trigger event being detected.

[0022] The personal information about the user may comprise a foreign language used by the user, and the user-specific customized version of the workflow may be presented in the foreign language used by the user.

[0023] The workflow application may be configured to interact with a language translation application to present the user-specific customized version of the workflow to the user in the foreign language used by the user based on speech-to-text and text-to-speech translation provided by the language translation application.

[0023] The personal information about the user may further comprise scheduled locations of the user at scheduled times, and the trigger event may comprise when the user is detected at a scheduled location at a scheduled time.

[0024] The trigger event may further comprise when the user is detected accessing an authentication or identification application.

[0025] The present invention also provides a computer-implemented method, comprising: storing, in a database, personal information about a user, a workflow to be completed by the user, and a trigger event to present the workflow on a device of the user; and accessing, by a workflow application, the database to generate a user-specific customized version of the workflow based on the personal information of the user; presenting, by the workflow application, the user-specific customized version of the workflow on the device of the user based on the trigger event being detected.

Brief Description of Drawings

[0026] Embodiments of the invention will now be described by way of example only with reference to the accompanying drawings, in which:

Figure 1 is a flow diagram of a method for initiating service of a personalised workflow from a workflow application to a user according to an embodiment of the present invention; and Figure 2 is a schematic diagram of a computer system for implementing an embodiment of the invention.

Description of Embodiments

[0027] Referring to Figure 1 , a method 100 for initiating service of a personalised workflow from a workflow application to a user according to an embodiment of the present invention may start at step 1 10 by storing user data relating to the user. The user data may, for example, comprise user profile data selected from the group consisting of a preferred or native language of the user, a language literacy of the user, a level of expertise of the user, a level of experience of the user, an education level of the user, and qualifications of the user.

[0028] Next, at step 120, workflow data relating to a workflow may be stored. The workflow data may, for example, comprise data selected from the group consisting of steps in the workflow, a location of the workflow, a duration of the workflow, and a scheduled time for the workflow.

[0029] The method 100 may move to step 130 by providing a workflow application configured to serve a personalised workflow to the user based on the user data and the workflow data.

[0030] The method 100 may end at step 140 where, in response to a trigger associated with the user or the workflow, initiating service of the personalised workflow from the workflow application to the user via a device accessible by the user. The device may, for example, comprise a mobile device such as a mobile phone, a tablet, or a laptop computer. Further or alternatively, the device may, for example, comprise a stationary device such as an access control device, an access kiosk, or a desktop computer.

[0031 ] In one embodiment, the trigger may be presentation at an access card reader of an access card having a unique ID associated with the user. The access card may be an ID card, the unique ID may be a unique QR code printed on the ID card, and the access card reader may be an entry kiosk with a QR scanner. When the user scans their ID card at the entry kiosk, the personalised workflow may be served to the user via the entry kiosk or a mobile device accessible by the user. [0032] Alternatively, the trigger may be a location or a time associated with the user or the workflow, and the personalised workflow may be served to the user via a mobile device accessible by the user.

[0033] The workflow application may, for example, comprise a voice-user interface configured to serve the personalised workflow to the user as text-to-voice translation of the workflow data. The personalised workflow may comprise the text-to-voice translation of the workflow data in the user’s preferred or native language.

[0034] The workflow application may be further configured to perform voice-to-text translation of voice responses received from the user in their preferred or native language. The workflow application may be further configured to store the voice-to-text translation of voice responses received from the user as workflow completion data.

[0035] The workflow application may be further configured to analyse the workflow completion data. The workflow application may be further configured to generate an alert based on analysis the workflow completion data.

[0036] The workflow may be a checklist, a survey, a questionnaire, or an audit. For example, the workflow may comprise a pre-start safety audit.

[0037] The workflow application may, for example, comprise the Talk 5® application described in detail in the present applicant’s WO 2020/053817. The method 100 may implemented by the system described in detail in the present applicant’s WO 2020/053817.

[0038] Referring to Figure 2, in some embodiments the invention may be implemented in a computer system 200 which comprises a database 210, a workflow application 220, and language translation application 230. The database 210 may store personal information about a user, a workflow to be completed by the user, and a trigger event to present the workflow on a device 240 of the user.

[0039] The workflow application 220 may be configured to access the database 210 to generate a user-specific customized version of the workflow based on the personal information of the user, and to present the user-specific customized version of the workflow on the device 240 of the user based on the trigger event being detected.

[0040] The personal information about the user may comprise a foreign language used by the user, and the user-specific customized version of the workflow may be presented in the foreign language used by the user. In this use-case, the workflow application 220 may be configured to interact with the language translation application 230 to present the userspecific customized version of the workflow to the user in the foreign language used by the user based on speech-to-text and text-to-speech translation provided by the language translation application 230.

[0041 ] The personal information about the user may further comprise scheduled locations of the user at scheduled times, and the trigger event may comprise when the user is detected at a scheduled location at a scheduled time. For example, the trigger event may be when the user is detected at a scheduled worksite at a scheduled start time.

[0042] The trigger event may further comprise when the user is detected accessing an authentication or identification application. For example, the trigger event may comprise when the user is detected using a biometric access control application at a location, or a personal identification application at a location.

[0043] The following Examples are intended to illustrate the invention. They are not intended to limit the scope of the invention.

Examples

Site access control

[0044] In this example the user may be a worker who needs to access a site having an access control kiosk at an access entry point. The workflow may be a site access checklist that the worker must complete to gain access to the site.

[0045] The worker may be issued with an ID card. A unique QR code for the worker may be printed on the ID card. The access control kiosk may have a QR scanner. When the worker scans their ID card at the access control kiosk, service of a personalised workflow from the Talk 5® workflow application may be initiated to the user via the access control kiosk.

[0046] The personalised workflow may comprise a text-to-voice translation of the site access checklist in the worker’s preferred or native language, such as Mandarin. The Talk 5® workflow application may perform voice-to-text translation of worker’s voice responses in Mandarin as text responses in English. The English text responses may be stored and analysed as workflow completion data for the site access checklist.

[0047] The workflow completion data may be analysed by checking the worker’s voice responses against their stored user profile or the required answers to the site access checklist. The worker may be denied access to the site and a security alert may be generated based on the analysis the workflow completion data, for example, if the worker’s voice responses do not match the stored user profile or the required answers to the site access checklist.

Driver logbook

[0048] In this example the user may be a truck driver driving a truck from a starting location to a destination location. The workflow may be completion of a logbook entry by the driver which records that the driver's work and rest hours are compliant with truck driver logbook rules.

[0049] The distance travelled by the truck and elapsed time from the starting location may be monitored using GPS tracking of the truck. After a predetermined distance or time, the Talk 5® workflow application may automatically initiate service of a personalised logbook entry workflow the driver via their mobile phone to complete their logbook. The driver’s user profile in the Talk 5® workflow application may record their preferred or native language as Hindi.

[0050] The personalised logbook entry workflow may comprise a text-to-voice translation of logbook entry fields in Hindi. The Talk 5® workflow application may perform voice-to- text translation of driver’s voice responses in Hindi as text responses in English. The English text responses may be stored and analysed as workflow completion data for the logbook entry. [0051] The Talk 5® workflow application may generate an alert or warning for the driver if the completed logbook entry does not comply with truck driver logbook rules.

Overseas event registration

[0052] In this example the user may be an attendee of an overseas event, such as an international business conference. The conference may be held in Korea, and the attendee’s user profile in the Talk 5® workflow application may record their preferred or native language as English.

[0053] The workflow may be a conference registration form in the Korean language that the attendee must complete on site at a registration kiosk at the entry to the conference venue to gain access to the conference. The attendee may have been issued with a registration confirmation email with a unique QR code. The registration kiosk may have a QR scanner. When the attendee scans their QR code at the registration kiosk, service of a personalised workflow from the Talk 5® workflow application may be initiated to the attendee via the registration kiosk.

[0054] The personalised workflow may comprise a text-to-voice translation of the Korean conference registration form in English. The Talk 5® workflow application may perform voice-to-text translation of attendee’s voice responses in English as text responses in Korean. The Korean text responses may be stored and analysed as workflow completion data for the conference registration form.

[0055] The workflow completion data may be analysed by checking the attendee’s voice responses against their stored user profile or the required answers to the conference registration form. The attendee may be denied access to the conference and a security alert may be generated based on the analysis the workflow completion data, for example, if the attendee’s voice responses do not match the stored user profile or the required answers to the conference registration form.

Pre-start safety audit

[0056] This example is the same as the site access control example above except that the workflow is a pre-start safety audit that must be completed before the worker starts work at the site. In this example, the worker may record their preferred or native language as Arabic.

[0057] When the worker scans their ID card at the access control kiosk and after the worker has completed the site access checklist to gain entry to the site, service of a personalised workflow from the Talk 5® workflow application may be initiated to the user via a mobile device of the worker.

[0058] The personalised workflow may comprise a text-to-voice translation of the pre-start safety audit for the site in the worker’s preferred or native language of Arabic. The Talk 5® workflow application may perform voice-to-text translation of worker’s voice responses in Arabic as text responses in English. The English text responses may be stored and analysed as workflow completion data for the pre-start safety audit.

[0059] The workflow completion data may be analysed by checking the worker’s voice responses against their stored user profile or the required answers to the pre-start safety audit. A safety alert may be generated based on the analysis the workflow completion data, for example, if the worker’s voice responses to the pre-start safety audit identify a potential safety hazard at the site.

[0060] The invention is not limited to the examples that have just been given. In other words, those skilled in the art will appreciate that the examples may be reproduced without difficulty, and with similar success, by substituting any of the generically or specifically described steps mentioned anywhere in this specification for those actually used in the preceding examples.

[0061 ] Embodiments of the present invention provide a method and system that are both generally and specifically useful for automatic call initiation from a voice-user interface to complete a workflow.

[0062] Unless the context requires otherwise, the word "comprising" means "including but not limited to," and the word "comprises" has a corresponding meaning.

[0063] Any reference to prior art is not an admission that the prior art is common general knowledge. [0064] The scope of the invention supported by the above examples is defined by the claims that follow.

Claims

1 . A method, comprising: storing user data relating to a user; storing workflow data relating to a workflow; providing a workflow application configured to serve a personalised workflow to the user based on the user data and the workflow data; in response to a trigger associated with the user or the workflow, initiating service of the personalised workflow from the workflow application to the user via a device accessible by the user.

2. The method of claim 1 , wherein the trigger comprises presentation at an access card reader of an access card having a unique identifier (ID) associated with the user.

3. The method of claim 2, wherein the access card is an ID card, the unique ID is a unique QR code printed on the ID card, and the access card reader is an entry kiosk with a QR scanner.

4. The method of claim 3, wherein, when the user scans their ID card at the entry kiosk, the personalised workflow is served to the user via the entry kiosk or a mobile device accessible by the user.

5. The method of claim 1 , wherein the trigger comprises a location or a time associated with the user or the workflow, and the personalised workflow is served to the user via a mobile device accessible by the user.

6. The method of claim 1 , wherein the workflow application comprises a voice-user interface configured to serve the personalised workflow to the user as text-to-voice translation of the workflow data.

7. The method of claim 6, wherein the user data comprises user profile data selected from the group consisting of a preferred or native language of the user, a language literacy of the user, a level of expertise of the user, a level of experience of the user, an education level of the user, and qualifications of the user.

8. The method of claim 7, wherein the workflow data comprises data selected from the group consisting of steps in the workflow, a location of the workflow, a duration of the workflow, and a scheduled time for the workflow.

9. The method of claim 8, wherein the personalised workflow comprises text-to-voice translation of the workflow data in the user’s preferred or native language.

10. The method of claim 9, wherein the workflow application is further configured to perform voice-to-text translation of voice responses received from the user in their preferred or native language.

11 . The method of claim 10, wherein the workflow application is further configured to store the voice-to-text translation of voice responses received from the user as workflow completion data.

12. The method of claim 11 , wherein the workflow application is further configured to analyse the workflow completion data.

13. The method of claim 12, wherein the workflow application is further configured to generate an alert based on analysis the workflow completion data.

14. The method of claim 1 , wherein the workflow comprises a checklist, a survey, a questionnaire, or an audit.

15. A system, comprising a memory, and a processor configured by instructions stored in the memory to perform operations comprising: storing user data relating to a user; storing workflow data relating to a workflow; providing a workflow application configured to serve a personalised workflow to the user based on the user data and the workflow data; in response to a trigger associated with the user or the workflow, initiating service of the personalised workflow from the workflow application to the user via a device accessible by the user.

16. A computer system, comprising: a database storing personal information about a user, a workflow to be completed by the user, and a trigger event to present the workflow on a device of the user; and a workflow application configured to access the database to: generate a user-specific customized version of the workflow based on the personal information of the user; present the user-specific customized version of the workflow on the device of the user based on the trigger event being detected.

17. The computer system of claim 16, wherein the personal information about the user comprises a foreign language used by the user, and the user-specific customized version of the workflow is presented in the foreign language used by the user.

18. The computer system of claim 17, wherein the workflow application is configured to interact with a language translation application to present the user-specific customized version of the workflow to the user in the foreign language used by the user based on speech-to-text and text-to-speech translation provided by the language translation application.

19. The computer system of claim 16, wherein the personal information about the user comprises scheduled locations of the user at scheduled times, and the trigger event comprises when the user is detected at a scheduled location at a scheduled time.

20. The computer system of claim 16, wherein the trigger event comprises when the user is detected accessing an authentication or identification application.

21 . A computer-implemented method, comprising: storing, in a database, personal information about a user, a workflow to be completed by the user, and a trigger event to present the workflow on a device of the user; and accessing, by a workflow application, the database to generate a user-specific customized version of the workflow based on the personal information of the user; presenting, by the workflow application, the user-specific customized version of the workflow on the device of the user based on the trigger event being detected.