WO2014078965A1 - System and method for managing several mobile devices simultaneously - Google Patents

System and method for managing several mobile devices simultaneously Download PDF

Info

Publication number
WO2014078965A1
WO2014078965A1 PCT/CA2013/050894 CA2013050894W WO2014078965A1 WO 2014078965 A1 WO2014078965 A1 WO 2014078965A1 CA 2013050894 W CA2013050894 W CA 2013050894W WO 2014078965 A1 WO2014078965 A1 WO 2014078965A1
Authority
WO
WIPO (PCT)
Prior art keywords
controllable
controller device
user interface
controllable devices
locking
Prior art date
Application number
PCT/CA2013/050894
Other languages
French (fr)
Inventor
Tan SOAMBOONSRUP
Jeremy TAN
Andrew LASSNER
Pimnapat LAPASSETHSIRI
Teesid KORSRILABUTR
Aran CHANANAR
Original Assignee
8303142 Canada Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 8303142 Canada Inc. filed Critical 8303142 Canada Inc.
Priority to CA2892614A priority Critical patent/CA2892614C/en
Priority to US14/646,797 priority patent/US9756049B2/en
Publication of WO2014078965A1 publication Critical patent/WO2014078965A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/10Network architectures or network communication protocols for network security for controlling access to devices or network resources
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/08Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/08Access security
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/08Access security
    • H04W12/082Access security using revocation of authorisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/30Security of mobile devices; Security of mobile applications
    • H04W12/37Managing security policies for mobile devices or for controlling mobile applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/20Services signaling; Auxiliary data signalling, i.e. transmitting data via a non-traffic channel
    • H04W4/21Services signaling; Auxiliary data signalling, i.e. transmitting data via a non-traffic channel for social networking applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/50Service provisioning or reconfiguring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/06Authentication

Definitions

  • the invention pertains to the field of systems, and methods for mobile devices.
  • the invention more particularly concerns a system and a method for controlling several mobile devices simultaneously.
  • Smart classroom is the term generally used to describe a classroom provided with technological tools such as interconnected servers, laptops, PC's, boards, projectors and the like.
  • a teacher is able to transmit/publish a course's content to the students with the use of such tools, instead of relying on traditional chalk or white boards on which teachers sometimes write.
  • the learning management system comprises controllable devices, each having a user interface, a processor for processing input commands received at the user interface, and a communication port for communicating via a communication network, each controllable device being operable in a locked configuration and in an unlocked configuration.
  • the learning management system further comprises a controller device having a communication port for sending locking and unlocking command signals via the communication network.
  • the learning management system further comprises a server system for interpreting and handling communications between the controllable devices and the controller device, in order to: receive the locking command signal from the controller device, and send in response thereto, a corresponding locking control signal to operate each of the controllable devices simultaneously in said locked configuration wherein the user interface of the controllable device is controlled by the controller device, and receive the unlocking command signal from the controller device, and send in response thereto, a corresponding unlocking control signal to operate each of the controllable devices from said locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device.
  • a server system for interpreting and handling communications between the controllable devices and the controller device, in order to: receive the locking command signal from the controller device, and send in response thereto, a corresponding locking control signal to operate each of the controllable devices simultaneously in said locked configuration wherein the user interface of the controllable device is controlled by the controller device, and receive the unlocking command signal from the controller device, and send in response thereto, a corresponding unlocking
  • a method of operating a learning management system comprising: (a) receiving, at a server system, a locking command signal from a controller device; and (b) processing, at the server system, the locking command signal and sending a corresponding locking control signal to controllable devices in order to simultaneously operate each of the controllable devices in said locked configuration wherein a user interface of each controllable device is controlled by the controller device.
  • a non-transitory storage medium comprising processor-readable data and instructions for receiving, at a server system, a locking command signal from a controller device, for processing the locking command signal and for sending a corresponding locking control signal to controllable devices in order to operate simultaneously each of the controllable devices in said locked configuration wherein a user interface of each controllable device is controlled by the controller device.
  • the present invention allows for providing a learning management system and method which can be implemented in classrooms without having to install a server within the school, and without having to use expensive computers.
  • Simple, low-cost touchscreen tablets can be used instead of desktop or laptops.
  • the system also advantageously allows the teacher to manage the learning content to be displayed on the controllable tablets of his/her students.
  • the system also allows for managing/controlling several tablets simultaneously. For example, a controlling device can allow for locking and/or displaying the same content on some or all of the controllable tablets.
  • the server system interprets the controller device's command signal, when the controller devices are in a locked mode of operation to control for example, the learning content to be presented on the controller devices' display screens and/or the user controls that are permitted by the students within this learning content.
  • FIGs. 1 A to 1 C show different screen captures of a controlling device interface.
  • FIGs. 1 D to 1 H show different screen captures of a controllable tablet interface.
  • FIG. 2 is a schematic representation of a learning management system, according to an embodiment of the invention, within its environment.
  • FIG. 3 is a block diagram of the authenticating and locking process, according to a first embodiment of the invention.
  • FIG. 4 is a block diagram of the synchronization process, according to the first embodiment of the invention.
  • FIG. 5 is a block diagram of the unlocking process, according to the first embodiment of the invention.
  • FIG. 6 is a block diagram of the authenticating and locking process, according to a second embodiment of the invention.
  • FIG. 7 is a block diagram of the synchronization process, according to the second embodiment of the invention.
  • FIG. 8 is a block diagram of the unlocking process, according to the second embodiment of the invention.
  • FIG. 9 shows a screen capture of a controlling device interface.
  • FIG. 10 is a block diagram of the subgrouping feature, according to an embodiment of the invention. While the invention will be described in conjunction with exemplified embodiments, it will be understood that these embodiments are not intended to limit the scope of the invention to such embodiments. On the contrary, the present invention is intended to cover all alternatives, modifications and equivalents as may be included as defined by the appended claims.
  • the tablet controlling system is an integrated learning management system for tablet computers that combines learning content management, video conferencing, and tablet management functionality into a single, easy to use software platform.
  • software platform it is meant the software located on remote servers, which allows for managing learning content, user access, user data, etc.
  • the software platform can also include applications stored on the tablets.
  • the software platform can run on a single server, but preferably runs on cloud-based clustered servers.
  • the software platform can be accessed remotely by touchscreen computer tablets, but also by PCs, laptops, smartphones and the like.
  • the system is a Learning Management System which comprises an Administrative Interface, referred to hereafter as the "Admin Interface", accessible from the web, and an LMS Web service, allowing access to authentication rights management and content using RESTful technologies.
  • the system also comprises a Locking and Synchronization Server (LSS) for controlling locking and synchronization functions between a controlling device (i.e. the teacher's) and several controllable tablets (i.e. the students').
  • the controllable tablets are Thai One-Tablet-Per-Child (OTPC) tablet, having stored therein a tablet application, such as the Braincloud Tablet application.
  • the system also comprises a web-accessible version of the tablet application, which can be accessed with any type of device, such as laptops, desktops, or tablets.
  • the software platform offers several advantages over other existing platforms, some of which are explained below. Indeed, the software platform is easy to use, and is especially adapted for K-12 education purposes.
  • the software platform includes an easy to use interface, which may be operated by elementary school students for example.
  • the software platform also includes a user interface which supports swipe and touch tablet gestures for selecting functions. It also comprises interconnecting functions allowing for the display of content from external sources, such as school news and/or ministry news.
  • the software platform also includes student profile functions and is able to store and access student data, student awards, and grades.
  • the software platform can also include a student calendar function, as well as functionalities allowing for the inclusion of third party applications and web links.
  • a course material function allows teachers to update course content to be viewed on students' and/or the teacher's tablets.
  • Another function, the course content management function allows teachers to directly update course content onto the tablet, via the clustered servers.
  • the platform also includes a quiz functionality allowing teachers to create quizzes and/or tests that can be used on the tablets.
  • the platform may include classroom connectivity functions, allowing video conferencing so as to permit students using tablet computers to remotely access a physically separate classroom via video conference that has been suitably equipped.
  • the video conferencing system permits students to access tutors for either one-on-one learning sessions or one-to-many learning sessions provided by tutors and teachers.
  • the platform management function allows teachers to control many tablets in a classroom setting. Teachers are able to lock, ie prevent students from using their tablets and teachers are able to send information and content to the tablets.
  • the platform also includes a function allowing reporting to an external organization, such as the Ministry of Education for example.
  • the platform can include or support a "Points and Rewards” system for education.
  • the "Points and Rewards” system can be included or separate from the platform, but accessible through it.
  • Such an application allows students to collect points while performing tasks on the tablet computer such as reading content and completing quizzes. Students earn points which can then be exchanged for rewards donated by corporations, NGOs, or other organisations.
  • the internet “Cloud” Server based tablet management system 10 is a client-server system, with several servers 14, 16, 18 providing services for different application functions.
  • the system 10 includes a Learning Management System (LMS) server 16.
  • LMS Learning Management System
  • the LMS server includes functions to authenticate and provide remote access to the controller 22, and controllable tablets 24.
  • the LMS server 16 includes a RESTful web service for authentication and for facilitating remote access to educational content by tablets running the tablet application.
  • the system 10 also includes a Locking and Synchronization Server (LSS) 14, including a function for locking/unlocking and syncing student tablets by teachers.
  • this function uses a variant protocol based on Comet optimized for single-publisher, multiple-subscriber message origination and transfer.
  • the LSS server 14 authenticates with the LMS server 16 web service for security to ensure that locking messages are sent from authorized sources.
  • An example of an authorized source is the teacher's controlling device 22, or any other authorized device.
  • each student attending the class of the teacher has their own tablet computer.
  • Locally installed on the student tablet is an operating system platform, such as Android or iOS for example, along with an application adapted to communicate with the remote clustered servers.
  • the student tablet can have an application for communicating directly with the teacher's controlling device (PC or tablet).
  • the application includes several functions, including a lock/unlock function which is activated by the controlling device of the teacher, via the remote servers.
  • Upon the teacher pressing the "lock" function on either one of a PC, laptop or tablet all functions including the touch interface and all buttons on the student tablets will be "locked", thereby preventing the students from accessing anything on the tablet.
  • the teacher has taken control of the tablet at this point.
  • messages can be transmitted using a variant Comet protocol that utilizes server-push technology to publish single-publisher multiple-listener messages in a lightweight manner.
  • each tablet 24 may connect to the LSS server 14 so as to subscribe to messages directed at the student, sent via a Private Channel.
  • Each controlling device 22 authenticates as a controlling/teacher tablet checks a Locking Channel associated with his or her class to determine the current locking state.
  • each Private Channel and Locking Channel is a RESET message, which persists when there is no other active message on the channel.
  • Active messages are those sent by message publishers (in this case, teachers) and persists on the channel for a configurable timeout period. Once an active message has been timed out, a RESET message is sent on that channel to reset all subscribers to their default states.
  • a SUBSCRIBE message is sent by the server to each student's private channel, thereby forcing each students' tablet application to subscribe to the locking channel of the class.
  • the SUBSCRIBE message persists on all private channels for a configurable timeout period.
  • LOCK message is pushed by the server 14 on that locking channel to all subscribed students.
  • the tablet 24 acknowledges the message, changes display elements in the user interface to indicate that the application is being locked, and disables all input handling of the tablet platform.
  • Controllable tablets 24 are unlocked when they receive an UNLOCK command from the server 14, which is triggered by a controlling device 22.
  • a RESET command can also unlock the controllable tablets.
  • each tablet 24 connects to the LSS server 14 so as to subscribe to messages directed at the student's class, sent via the Locking Channel 52.
  • Each controlling device 22 authenticates as a controlling/teacher tablet checks a Locking Channel associated with his or her class to determine the current locking state.
  • each Locking Channel 52 The default state of each Locking Channel 52 is a RESET message, which persists when there is no other active message on the channel. Active messages are those sent by message publishers (in this case, teachers) and persists on the channel for a configurable timeout period. Once an active message has been timed out, a RESET message is sent on that channel to reset all subscribers to their default states.
  • the controlling device 22, pushes a LOCK message via the server 14 on that Locking Channel 52 to all subscribed students, thereby locking the interfaces of the controllable tablets 24, for students of a given class. Once a student tablet receives a LOCK message, the tablet 24 acknowledges the message, changes display elements in the user interface to indicate that the application is being locked, and disables all input handling of the tablet platform.
  • Controllable tablets 24 are unlocked when they receive an UNLOCK command from the server 14, which is triggered by a controlling device 22.
  • a RESET command can also unlock the controllable tablets.
  • FIG. 1 A shows the home page accessible on the controlling device 22, for the teacher.
  • This interface includes several navigation tools, at the bottom right of the interface, including a notification of the current locking state of the teacher's locking channel. In this case, the locking state is "unlock".
  • FIG. 1 D shows a student home screen in an unlocked state.
  • the navigation tools are different than those of the controlling device.
  • the Lock notification changes to the locked state, and the synchronize button appears.
  • FIG. 1 E when the teacher presses the lock button, a student in that teacher's locking channel will receive a notification that his or her tablet is now locked. A large lock icon is displayed for a few seconds before disappearing.
  • FIG. 1 F after the lock notification disappears, the student's navigation icons will show only a button displaying the locked state of the tablet.
  • the LMS server 16 preferably includes an Administration interface which allows interacting with the content stored on an external server, such as a Moodle server 20. Accessing the course content can be done via an application installed on the tablet, or via a web-browser.
  • teachers are able to browse content, via their tablets 24, within a web browser contained within the learning management system.
  • the teacher is able to access the learning management system (LMS) using any web browser.
  • the teacher accesses the LMS through the "Admin Interface", which is a web-accessible interface to the LMS server.
  • teachers can access course content from the clustered servers 12 using a web browser from a desktop or desktop computer, as long as the device has been authenticated as a controlling/teacher's device.
  • the course material and content is located within the online "cloud" LMS server 16 and stored within a database 20.
  • the course content is preferably rendered on the teacher's device as a webpage. Preferably, it is possible to browse external Internet websites via the LMS server 16.
  • All content is rendered according to the templates and methods of input using the learning management system.
  • formatting and rendering of the data and templates are predefined, using HTML, but of course, other languages can be considered.
  • a teacher can continue to browse the application, or browse through the web-based version of the application, while his or her locking channel is in the locked state. Once a teacher has selected content that should be displayed on the student's tablet, he or she can click the synchronize button, as it will be explained more in detail below.
  • the system 10 can also allow the controlling devices 22 of teachers, once they have browsed to either course content or websites they wish to display on the student tablets, to synchronize with the students' tablets 24 by pressing a "synchronize" button (on the tablet application - if using a tablet, or via the web-based application control panel - if using a laptop) to force all the student tablets 24 that they have previously locked to load the synchronized content.
  • a "synchronize" button on the tablet application - if using a tablet, or via the web-based application control panel - if using a laptop
  • the controlling device via either one of the Braincloud Tablet application or the Braincloud-on-the-Web
  • the teacher clicks on the synchronize button on his or her control panel a REDIRECT message will be sent to the teacher's class Locking Channel with the URI, content ID, or URL as the REDIRECT argument.
  • the LSS server 14 will broadcast that message on the Locking Channel via a server push message to all student tablets 24 subscribing to that Locking Channel. Tablets 24 which receive a REDIRECT message and which are in a locked state will redirect the tablet view to the page URI, content ID, or website URL as specified in the message argument.
  • the teacher may broadcast as many REDIRECT messages using the sync button as necessary during a locked session to his or her class' Locking Channel while the channel state is locked. Referring to FIG. 1 G, while in the locked state on a teacher's locking channel, a student's tablet receiving a synchronized message will immediately show the content that the teacher has synched to. The student still cannot navigate or browse, but is able to scroll the content.
  • the students are able to browse any particular course content.
  • the student's tablet is in the unlocked state (the lock button at the bottom right of the screen has disappeared) and he/she is able to browse any content or web page available from the application.
  • the controlling device will know which content or web page the teacher has browsed by recording the page URI, content ID, or website URL selected by the teacher (via either one of the Braincloud Tablet application or the Braincloud-on-the-Web).
  • the controlling device will also know the current viewport position of the content as it is being viewed by the teacher.
  • a REDIRECT message will be sent to a Redirect Channel 55 of teacher's class, with the URI, content ID, or URL, and the current viewport position of the content, as the REDIRECT argument.
  • the LSS server 14 will broadcast that message on the Redirect Channel 55 via a server push message to all student tablets 24 subscribing to that Redirect Channel 55.
  • Tablets 24 which receive a REDIRECT message and which are in a locked state will redirect the tablet view to the page URI, content ID, or website URL, and position the viewport of the student tablet in the exact position of the teacher's view, as specified in the message argument.
  • the teacher may broadcast as many REDIRECT messages using the sync button as necessary during a locked session to his or her class' Redirect Channel 55 while the channel state is locked.
  • a student's tablet receiving a first synchronized message to a particular piece of content will immediately show the content that the teacher has synched to (see FIG. 1 G).
  • the student still cannot navigate or browse, but is able to scroll the content.
  • Any subsequent REDIRECT messages to the same piece of content which repositions the viewport according to the viewport position of the teacher will disallow scrolling of the content by the student for a certain period of time.
  • the teacher unlocks the tablets, the students are able to browse any particular course content.
  • the student's tablet is in the unlocked state (the lock button at the bottom right of the screen has disappeared) and he/she is able to browse any content or web page available from the application.
  • the LSS server is configured to allow teachers to break up a classroom's students into subgroups, allowing them to work on separate group tasks while all within the same classroom.
  • a controlling tablet once it has locked controllable tablets of a classroom, accesses an additional control screen allowing the teacher, via the controlling tablet, to create subgroups within each class.
  • a screenshot of the control screen is shown in FIG. 9.
  • the control screen of the user interface 32 is split into two sections 100, 102.
  • the first section 100 i.e. top half
  • the second section 102 i.e. bottom half
  • a teacher may, via the controlling tablet 22 proceed with any of the following operations:
  • Group assignments for a class persist for the entire life of the classroom, i.e. as long as the classroom exists within the LMS 16, the state of student grouping will continue to exist.
  • REDIRECT messages will be sent only to that group via the modifications to the Synchronizing Information and Content method as will be better described below.
  • the teacher may return to the control screen 32 at any time and select another group, or to select the entire class for locking and/or synchronization.
  • SAWS 106 In order to allow persistence of group assignment state, a subgroup assignment webservice (SAWS) 106 allows assignment state to be saved and retrieved. Communication with the server is performed by authenticated controlling tablets via a RESTful request and response protocol. The operations allowed on SAWS 106 are:
  • Controlling tablets 22 will query SAWS 106 upon a first lock operation 116 by the teacher.
  • Controllable tablets 24 will query SAWS 106 once the first classroom-wide LOCK message is received 120 from a controlling tablet 22 to determine the student user's group assignment if it exists within the classroom Locking Channel 52.
  • Students are grouped and ungrouped within a classroom via an additional set of commands sent through the classroom's Locking Channel 52.
  • controllable tablet 24 belongs to a group, it will also subscribe to REDIRECT messages 120 sent 118 by the controlling tablet 22 on a second Redirect Group Channel 110 along with its main Redirect Channel 55 on the LSS 14.
  • Commands may be sent from the controlling tablet 22 to its controllable tablets 24 via the main Locking Channel 52.
  • the SETGROUP command 112 is sent by the controlling tablet 22 along with its parameters, a group id and a user id, and is received 124 at a controllable tablet 24 operated by a student user with that user id listening on the Lock Channel 52.
  • the SETGROUP command 124 forces the controllable tablet 24 to subscribe to the Locking Group Channel 108 with that group id.
  • the UNSETGROUP command 114 is sent by the controlling tablet 22 along with a user id parameter, and is received 126 at a controllable tablet 24 operated by a student user with that user id listening on the Lock Channel 52 to unsubscribe from any Locking Group Channels 108 to which it is currently subscribed.
  • SETGROUP and UNSETGROUP commands 112, 114 may only be sent on the main Locking Channel 52, and not on the Locking Group Channel 108, in accordance with the present embodiment.
  • a controlling tablet 22 will send messages according to the Locking Group Channel 108 or Redirect Group Channel 110 corresponding to the selected group in the group control screen 32, or to the main Locking or Redirect Channel 52, 55 if no groups are selected.
  • Controllable tablets 24 will receive messages on the main Locking or Redirect Channel 52, 55 and on the Locking or Redirect Group Channel 108, 110, it is assigned based on the initial state received from the query to SAWS 106 or on subsequent commands sent via the LSS 14.
  • controlling device 22 does not necessarily need to be located within the same room as the controllable tablets 24, since all communications can be made via internet connections. Students with their tablets may also be dispersed in different locations.
  • the present system 10 allows for a controlling device 22 to control several computer tablets 24 simultaneously, via a remote server 12.
  • the controlling device 22 is preferably a laptop or desktop, but it can also consist of a computer tablet or smartphone, or any similar device.
  • the controlling device may not only lock the controllable tablets, it can also manage the content to be displayed on the tablets 24. While the preferred embodiment described herein is especially adapted for a learning management system, it is possible to use such a system for other applications, such as in the field of health care, where a doctor would be provided with the controlling device 22 and nurses or patients would be provided with the controllable tablets 24.
  • the learning management system 10 illustrated in FIG. 2 (also referred to herein as “tablet management system” or “system”) will now be described in other terms.
  • the learning management system 10 shown in FIG. 2 comprises the controllable devices 24, generally intended for respective students 25.
  • Each controllable device 24 has a user interface 32, a processor 34 for processing input commands received at the user interface 32, and a communication port 36 for communicating via a communication network 40.
  • Each controllable device 24 further comprises a memory 38.
  • Each controllable device 24 is operable in a locked configuration and in an unlocked configuration.
  • the controllable devices 24 are provided by tablet computers, but may alternatively be provided by any suitable general purpose computer, portable computer, Personal digital assistant (PDA), smart phone, mobile phone, and/or the like.
  • PDA Personal digital assistant
  • the user interface 32 comprises a display screen, which is a touch screen, and may alternatively or additionally comprise a regular display screen, a keyboard, a virtual keyboard, a mouse, a mouse pad, a microphone, a speaker, and/or the like.
  • the communication port 36 enables wireless communication with the server system 12.
  • the system 10 further comprises a controller device 22 (also referred to in the present by "controlling device” or “controlling tablet”), generally intended for a teacher 23.
  • the controller device 22 has a communication port 46 for sending locking and unlocking command signals, wirelessly, via the communication network 40.
  • the controllable devices 24 may be provided by any suitable general purpose computer, tablet computer, portable computer, PDA, smart phone, mobile phone, and/or the like, and further comprises a user interface 42, a processor 44 and a memory 48.
  • the system 10 further comprises a server system 12 for interpreting and handling communications between the controllable devices 24 and the controller device 22.
  • the server system 12 receives 70 the locking command signal 68 from the controller device 24, and sends in response thereto, a corresponding locking control signal 72 to operate each of the controllable devices 24 simultaneously in said locked configuration in which the user interface 32 of the controllable device 24 is controlled by the controller device 22.
  • the user interface 32 in the locked configuration, is controlled by the controller device 22 to present learning content restricted by the controller device 22, for example a particular webpage, a particular course content, a particular lesson and/or the like, which may be provided as static readable data, or in the form of an exercise or test capable or receiving student input.
  • the controllable device still provides some user interface control to a user, i.e. a student 25 (see FIG. 2), in that the student may scroll within the content and/or input information within the present learning content.
  • the restricted content includes video or other recorded content
  • the controllable device may enable the student, in the locked configuration, to still navigate within the recorded content.
  • the student may be enabled, in the locked configuration, to still navigate within those pages.
  • the processing of input commands by the processor 34 at the controllable devices 24 is restricted to respond to input commands related to the restricted learning content, in order to prevent the user of the controllable device from consuming data beyond the restricted learning content.
  • the server system 12 receives 96 the unlocking command signal 94 from the controller device 22, and sends in response thereto, a corresponding unlocking control signal 97 to operate each of the controllable devices 24 from said locked configuration to the unlocked configuration 98 wherein the user interface is operable independently of the controller device, i.e. the controllable devices 24 are disengaged from the controller device 22.
  • the server system 12 may be provided by a plurality of servers which cooperate together to operate the system. Alternatively, the server system 12 may be provided by a single server. The server system 12 may be located on site (in the classroom or near the controller device 22, for example) or it may be located remotely from the devices 22, 24
  • the server system 12 comprises cloud-based clustered servers, including the Locking and Synchronization System (LSS) 14 for managing locking and unlocking of the controllable devices 24 by the controller device 22, and further including the Learning Management System (LMS) server 16 for managing authentication rights of users associated to the controllable devices 24 and for managing content to be distributed to the controllable devices 24.
  • the cloud-based clustered servers 12 preferably include other servers represented by 18, for storing, managing statistical information, student information and/or the like.
  • the LMS 16 server comprises an administrative interface accessible via the Internet.
  • the learning management system 10 further comprises a database 20 for storing the content to be distributed, the database being in communication with the server system 12 It is to be understood that the communication between the server system 12 and the different components of the system 10 (controller devices 22, the controllable devices 24, the database 20) may each be handled over different communication networks, in accordance with embodiments of the present, as a skilled reader would understand.
  • the term "communication network” refers to any suitable communication means and may be provided by a wide area network (WAN) such as the Internet, a local area network (LAN), a cable connection, a wireless connection, a data network, a telephone network, and/or the like.
  • WAN wide area network
  • LAN local area network
  • wireless connection a wireless connection
  • data network a data network
  • telephone network a telephone network, and/or the like.
  • the system may comprises a plurality of controller devices 22 which cooperate to control a same group of controllable devices 24.
  • a plurality of controller devices 22 may be provided, each being associated to distinct groups of controllable devices 24, i.e. different smart classrooms.
  • a same controller device 22 may operate for a given set of controllable devices 24 at a given time, and with one or more other sets at other times.
  • a method 50 of authenticating and locking is shown in FIG. 3.
  • the LSS server 14 Upon receiving an authentication request 60 from one of the controllable devices 24, the LSS server 14 connects the controllable device 24 to the LSS server 14 via a corresponding Private Channel 54 and sets a default state on the Private Channel 54, i.e. send a RESET message on the Private Channel 52, as shown at bloc 62.
  • the LSS server 14 Upon receiving an authentication request 64 from the controller devices 22, the LSS server 14 connects the controller device 22 to the LSS server 14 via the Locking Channel 52 and sets a default state on the Locking Channel 52, i.e. send a RESET message on the Locking Channel 52, as shown at bloc 66.
  • the LSS server 14 (a) receives 70 a locking command signal 68 from the controller device 22, the LSS server 14 (b) processes the locking command signal 68 and sends a corresponding locking control signal to controllable devices 24.
  • the LSS server 14 sends a SUBSCRIBE message 72 on the private channels 54 to force each controllable device to subscribe to the locking channel; and then sends a LOCK message 78 on the locking channel 52 to be received 80 by the respective controllable devices 24, in order to simultaneously operate each of the controllable devices 24 in the locked configuration.
  • a method 56 of synchronizing the controllable device 24 with the controller device 22 is shown in FIG. 4.
  • the learning content to be distributed to the controllable devices 24 is selected 82 at the controller device 22, which is then synchronized with the controllable devices 24 to force the controllable devices 24 to load the selected learning content.
  • the synchronizing comprises receiving 86 at the LSS server 14 a content identifier being associated to the learning content having been selected and having been sent 84 by the controller device 22; and upon receiving a synchronize command signal 88 from the controller device 22, sending 90 a REDIRECT message and the content identifier on the locking channel 52, in order to present 92, on the user interface of each controllable device 24, the selected learning content based on the content identifier.
  • the steps for unlocking 58 the controllable devices 24 is shown in FIG. 5.
  • the controller device 22 sends 94 an unlocking command signal which is received 96 at the LSS server 14.
  • the LSS server 14 sets 97 the Private and Locking Channels 52, 54 to a default status, i.e. by sending a RESET message which is received 98 at the controllable devices 24, in order to operate simultaneously each of the controllable devices from the locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device.
  • the LSS server 14 upon receiving an authentication request 60 from one of the controllable devices 24, the LSS server 14 connects the controllable device 24 to the LSS server 14 on the Locking Channel 52 requested by the controllable device 24, depending on the enrollment status of the student using the controllable device 24 as specified on the LMS 16.
  • the LSS server 14 Upon receiving an authentication request 64 from the controller devices 22, the LSS server 14 connects the controller device 22 to the LSS server 14 via the Locking Channel 52 and sets a default state on the Locking Channel 52, i.e. send a RESET message on the Locking Channel 52, as shown at bloc 66.
  • the LSS server 14 processes the locking command signal 68 and sends a corresponding locking control signal to controllable devices 24. More particularly, the LSS server 14 sends a LOCK message 78 on the locking channel 52 to be received 80 by the respective controllable devices 24, in order to simultaneously operate each of the controllable devices 24 in the locked configuration.
  • a method 56 of synchronizing the controllable device 24 with the controller device 22, in the context of the second embodiment is shown in FIG. 7.
  • the learning content to be distributed to the controllable devices 24 is selected 82 at the controller device 22, which is then synchronized with the controllable devices 24 to force the controllable devices 24 to load the selected learning content.
  • the synchronizing comprises receiving 86 at the LSS server 14 a content identifier being associated to the learning content having been selected and having been sent 84 by the controller device 22; and upon receiving a synchronize command signal 88 from the controller device 22, sending 90 a REDIRECT message and the content identifier on the redirect channel 54, in order to present 92, on the user interface of each controllable device 24, the selected learning content based on the content identifier.
  • the controller device 22 sends 94 an unlocking command signal which is received 96 at the LSS server 14.
  • the LSS server 14 sets 97 the Locking Channel 52 to a default status, i.e. by sending a RESET message which is received 98 at the controllable devices 24, in order to operate simultaneously each of the controllable devices from the locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device.
  • a learning management system comprising: controllable devices, each having a user interface, a processor for processing input commands received at the user interface, and a communication port for communicating via a communication network, each controllable device being operable in a locked configuration and in an unlocked configuration; and a controller device having a communication port: for sending a locking command signal to the controllable devices via the communication network, in order to operate each of the controllable devices in said locked configuration wherein the user interface is controlled to present learning content restricted by the controller device and wherein the processor is restricted to respond to input commands related to the restricted learning content; and for further sending an unlocking command signal to the controllable devices via a communication network, in order to operate each of the controllable devices from said locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device.
  • An input command may be defined as a user input or user command entered at the controllable device, and preferably includes a scrolling command to allow independent scrolling at each device within the viewable learning content, and may also include editing, for example filing out an exercise or test.
  • the user interface is responsive to user commands performed within the restricted learning content.
  • at least one or more of said controllable devices and of said controller device is provided by a tablet computer.
  • a method of operating a learning management system comprising: (a) sending a locking command signal to controllable devices in order to operate each of the controllable devices in said locked configuration wherein a user interface of each controllable device is controlled to present learning content restricted by a controller device and wherein the processor is restricted to respond to input commands related to the restricted learning content.
  • the method further comprises (b) sending an unlocking command signal to controllable devices in order to operate each of the controllable devices in said unlocked configuration wherein the user interface is operable independently of the controller device.
  • the user interface of each controllable device comprises a display screen, the learning content being displayed on the display screen, and wherein the input commands related to the restricted learning content include scrolling within the learning content displayed.
  • a non-transitory storage medium comprising processor-readable data and instructions for sending a locking command signal to controllable devices in order to operate each of the controllable devices in said locked configuration wherein a user interface of each controllable device is controlled to present learning content restricted by a controller device and wherein the processor is restricted to respond to input commands related to the restricted learning content.
  • the non-transitory storage medium further comprises processor-readable data and instructions for sending an unlocking command signal to controllable devices in order to operate each of the controllable devices in said unlocked configuration wherein the user interface is operable independently of the controller device.
  • a tablet management system comprising:
  • controllable tablets each provided with a processor, a memory, a touchscreen for displaying an interface, and wireless connection capabilities for communicating with said at least one server, and
  • controlling device provided with a processor, a memory, a screen for displaying a controlling interface, and wireless connection capabilities for communicating with said at least one server,
  • the server being able to authenticate the controlling device and controllable tablets, and the controller device being adapted to control simultaneously the controllable tablets through the controllable interface.
  • the tablet management system is a learning management system.
  • the controlling device controls the controllable tablets via the server.
  • the controlling device is one of: a tablet, a laptop, a desktop, or any other device able to access the at least one server through a secure web interface.
  • controlling interface is a web-page accessible through a web browser, while in another embodiment, the controlling interface is an application stored within the controlling PC or tablet memory.
  • the controlling device comprises means for locking and/or synchronizing the tablets.
  • the at least one server comprises several cloud- based clustered servers.
  • the cloud-based clustered servers include a Locking and Synchronization System (LSS) and Learning Management System (LMS) server.
  • the tablets include web-browsing capabilities.
  • the tablets include an application for displaying and interacting with learning content stored on the at least one server.
  • the authenticating capabilities allow creating a locking channel with the controller tablet and a private channel with each of the controllable tablet.
  • the authenticating capabilities allow creating a locking channel with the controller tablet and a redirect channel with each of the controllable tablet.
  • a method for managing several tablets simultaneously comprises the steps of:
  • - Providing a Learning Management System including at least one server, a controlling device, and several controllable tablets;
  • the method further comprises a step of synchronizing learning content to be displayed on the controllable tablets.

Abstract

A learning management system and method. Controllable devices, generally intended for students of a smart classroom, are each operable in a locked configuration and in an unlocked configuration. A controller device, generally intended for a teacher of a smart classroom, is configured to send command signals over a communication network. A server system interprets and handles communications between the controllable devices and the controller device such that when a locking signal is sent from the teacher's controller device, the server system sets each of the controllable devices to the locked configuration in which the user interface of each controllable device is controlled by the controller device, and when an unlocking signal is received from the teacher's controller device, the server system sets each of the controllable devices from the locked configuration to the unlocked configuration in which the user interface is operable independently of the controller device.

Description

SYSTEM AND METHOD FOR MANAGING SEVERAL MOBILE DEVICES
SIMULTANEOUSLY
FIELD OF THE INVENTION
The invention pertains to the field of systems, and methods for mobile devices. The invention more particularly concerns a system and a method for controlling several mobile devices simultaneously. BACKGROUND OF THE INVENTION
"Smart Classroom" is the term generally used to describe a classroom provided with technological tools such as interconnected servers, laptops, PC's, boards, projectors and the like. In a "Smart Classroom", a teacher is able to transmit/publish a course's content to the students with the use of such tools, instead of relying on traditional chalk or white boards on which teachers sometimes write.
There are several products on the market addressing the needs of "Smart Classrooms", such as interactive white boards, conferencing software, etc. Existing products for "Smart Classrooms" are generally directed to schools in developed countries, in which it is sometimes feasible to install dedicated servers within the school and to provide each student with a laptop or desktop computer.
Unfortunately, existing products are not well adapted for schools in developing countries, which could greatly benefit from the concept of "Smart Classrooms". Indeed, existing software requires a lot of processing capacity which cannot be supported by older computers or by low-cost PCs. In addition, existing solutions generally require having the servers or computers, which manage the content to be displayed on the students' computers, to be physically located within the same room, within the same school, or at least within the same Local Area Network (LAN).
Many of the schools in developing countries have limited resources in terms of computers and/or IT services. They sometimes are not even provided with one computer within the school, and thus it can be difficult to transpose existing "smart classroom" learning tools in schools in these countries.
There is thus a need for a system and/or process which would allow students enrolled in schools with little or no access to technological tools to benefit from the advantages of "smart classrooms". It would also be desirable for such a system to be deployed without requiring expensive servers and/or PC's physically located in the schools. It would also be desirable for teachers to be able to create and manage learning content easily, and to be able to control this content when displayed to their students.
Known to the Applicant are United States Patents Nos.: 4,652,240 (WACKYM); 4,715,818 (SHAPIRO et al.); US 4,785,472 (SHAPIRO); 6,41 1 ,796 B1 (REMSCHEL); 6,928,260 B2 (BETZ et al.); 8,358,963 B2 (ARGOTT); and United States Patent Applications published under Nos.: 2004/0191744 A1 (GUIRGUIS); 2006/0147891 A1 (DREYFOUS et al.); 2010/0267000 A1 (CROUCH); 2012/0231434 A1 (STANDAGE); as well as Japanese Patent Applications published under Nos.: 2007052148 A (NOMOTO) and 2012127989 A (HAYASHI et al.). However, these documents suffer from drawbacks as will be better understood in light of the foregoing description. Hence, there is a need for an improved system which, by virtue of its design and components, would be able to overcome some of the above-discussed prior art concerns. SUMMARY OF THE INVENTION
It is an object of the present invention to respond to at least one of those above- mentioned needs.
In accordance with an aspect of the present, there is provided a learning management system. The learning management system comprises controllable devices, each having a user interface, a processor for processing input commands received at the user interface, and a communication port for communicating via a communication network, each controllable device being operable in a locked configuration and in an unlocked configuration. The learning management system further comprises a controller device having a communication port for sending locking and unlocking command signals via the communication network. The learning management system further comprises a server system for interpreting and handling communications between the controllable devices and the controller device, in order to: receive the locking command signal from the controller device, and send in response thereto, a corresponding locking control signal to operate each of the controllable devices simultaneously in said locked configuration wherein the user interface of the controllable device is controlled by the controller device, and receive the unlocking command signal from the controller device, and send in response thereto, a corresponding unlocking control signal to operate each of the controllable devices from said locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device.
In accordance with another aspect of the present, there is provided a method of operating a learning management system comprising: (a) receiving, at a server system, a locking command signal from a controller device; and (b) processing, at the server system, the locking command signal and sending a corresponding locking control signal to controllable devices in order to simultaneously operate each of the controllable devices in said locked configuration wherein a user interface of each controllable device is controlled by the controller device. In accordance with yet another aspect of the present, there is provided a non-transitory storage medium comprising processor-readable data and instructions for receiving, at a server system, a locking command signal from a controller device, for processing the locking command signal and for sending a corresponding locking control signal to controllable devices in order to operate simultaneously each of the controllable devices in said locked configuration wherein a user interface of each controllable device is controlled by the controller device.
Advantageously, the present invention allows for providing a learning management system and method which can be implemented in classrooms without having to install a server within the school, and without having to use expensive computers. Simple, low-cost touchscreen tablets can be used instead of desktop or laptops. The system also advantageously allows the teacher to manage the learning content to be displayed on the controllable tablets of his/her students. The system also allows for managing/controlling several tablets simultaneously. For example, a controlling device can allow for locking and/or displaying the same content on some or all of the controllable tablets.
Advantageously, the server system interprets the controller device's command signal, when the controller devices are in a locked mode of operation to control for example, the learning content to be presented on the controller devices' display screens and/or the user controls that are permitted by the students within this learning content. BRIEF DESCRIPTION OF THE DRAWINGS
The present invention and its advantages will be better understood and apparent upon reading the following detailed description made with reference to the accompanying drawings wherein:
FIGs. 1 A to 1 C show different screen captures of a controlling device interface.
FIGs. 1 D to 1 H show different screen captures of a controllable tablet interface.
FIG. 2 is a schematic representation of a learning management system, according to an embodiment of the invention, within its environment.
FIG. 3 is a block diagram of the authenticating and locking process, according to a first embodiment of the invention.
FIG. 4 is a block diagram of the synchronization process, according to the first embodiment of the invention.
FIG. 5 is a block diagram of the unlocking process, according to the first embodiment of the invention.
FIG. 6 is a block diagram of the authenticating and locking process, according to a second embodiment of the invention. FIG. 7 is a block diagram of the synchronization process, according to the second embodiment of the invention.
FIG. 8 is a block diagram of the unlocking process, according to the second embodiment of the invention.
FIG. 9 shows a screen capture of a controlling device interface. FIG. 10 is a block diagram of the subgrouping feature, according to an embodiment of the invention. While the invention will be described in conjunction with exemplified embodiments, it will be understood that these embodiments are not intended to limit the scope of the invention to such embodiments. On the contrary, the present invention is intended to cover all alternatives, modifications and equivalents as may be included as defined by the appended claims.
DESCRIPTION OF PREFERRED EMBODIMENTS In the following description, similar features in the drawings have been given similar reference numerals. To preserve the clarity of the drawings, some reference numerals may have been omitted if they were already identified in a preceding figure.
In one embodiment of the invention, the tablet controlling system is an integrated learning management system for tablet computers that combines learning content management, video conferencing, and tablet management functionality into a single, easy to use software platform. By software platform, it is meant the software located on remote servers, which allows for managing learning content, user access, user data, etc. In some embodiment, the software platform can also include applications stored on the tablets.
The software platform can run on a single server, but preferably runs on cloud-based clustered servers. The software platform can be accessed remotely by touchscreen computer tablets, but also by PCs, laptops, smartphones and the like.
Referring to Figures 1A-1 H and Figure 2, according to a preferred embodiment, the system is a Learning Management System which comprises an Administrative Interface, referred to hereafter as the "Admin Interface", accessible from the web, and an LMS Web service, allowing access to authentication rights management and content using RESTful technologies. The system also comprises a Locking and Synchronization Server (LSS) for controlling locking and synchronization functions between a controlling device (i.e. the teacher's) and several controllable tablets (i.e. the students'). Preferably, the controllable tablets are Thai One-Tablet-Per-Child (OTPC) tablet, having stored therein a tablet application, such as the Braincloud Tablet application. The system also comprises a web-accessible version of the tablet application, which can be accessed with any type of device, such as laptops, desktops, or tablets. The software platform offers several advantages over other existing platforms, some of which are explained below. Indeed, the software platform is easy to use, and is especially adapted for K-12 education purposes.
The software platform includes an easy to use interface, which may be operated by elementary school students for example. The software platform also includes a user interface which supports swipe and touch tablet gestures for selecting functions. It also comprises interconnecting functions allowing for the display of content from external sources, such as school news and/or ministry news. The software platform also includes student profile functions and is able to store and access student data, student awards, and grades. The software platform can also include a student calendar function, as well as functionalities allowing for the inclusion of third party applications and web links.
A course material function allows teachers to update course content to be viewed on students' and/or the teacher's tablets. Another function, the course content management function, allows teachers to directly update course content onto the tablet, via the clustered servers. Preferably, the platform also includes a quiz functionality allowing teachers to create quizzes and/or tests that can be used on the tablets. Still preferably, the platform may include classroom connectivity functions, allowing video conferencing so as to permit students using tablet computers to remotely access a physically separate classroom via video conference that has been suitably equipped.
Still preferably, the video conferencing system permits students to access tutors for either one-on-one learning sessions or one-to-many learning sessions provided by tutors and teachers.
The platform management function allows teachers to control many tablets in a classroom setting. Teachers are able to lock, ie prevent students from using their tablets and teachers are able to send information and content to the tablets. Optionally, the platform also includes a function allowing reporting to an external organization, such as the Ministry of Education for example.
Optionally, the platform can include or support a "Points and Rewards" system for education. The "Points and Rewards" system can be included or separate from the platform, but accessible through it. Such an application allows students to collect points while performing tasks on the tablet computer such as reading content and completing quizzes. Students earn points which can then be exchanged for rewards donated by corporations, NGOs, or other organisations.
Referring now to FIG. 2, the internet "Cloud" Server based tablet management system 10 is a client-server system, with several servers 14, 16, 18 providing services for different application functions.
The system 10 includes a Learning Management System (LMS) server 16. The LMS server includes functions to authenticate and provide remote access to the controller 22, and controllable tablets 24. Preferably, the LMS server 16 includes a RESTful web service for authentication and for facilitating remote access to educational content by tablets running the tablet application. The system 10 also includes a Locking and Synchronization Server (LSS) 14, including a function for locking/unlocking and syncing student tablets by teachers. Preferably, this function uses a variant protocol based on Comet optimized for single-publisher, multiple-subscriber message origination and transfer. The LSS server 14 authenticates with the LMS server 16 web service for security to ensure that locking messages are sent from authorized sources. An example of an authorized source is the teacher's controlling device 22, or any other authorized device.
Once the authenticating process has succeeded, several functions can be accessed by the controlling device 22, three of which are a) a lock/unlock function, b) a browse course information and content function, and c) a synch information and content function.
Each of the functional features of the system will be described below, in accordance with an exemplary embodiment, with reference to FIG. 3 to 5, and in accordance with an alternate embodiment, with reference to FIG. 6 to 8.
Lock / Unlock function
In one example of the lock/unlock function's use, each student attending the class of the teacher has their own tablet computer. Locally installed on the student tablet is an operating system platform, such as Android or iOS for example, along with an application adapted to communicate with the remote clustered servers. In some embodiments, the student tablet can have an application for communicating directly with the teacher's controlling device (PC or tablet). The application includes several functions, including a lock/unlock function which is activated by the controlling device of the teacher, via the remote servers. Upon the teacher pressing the "lock" function on either one of a PC, laptop or tablet, all functions including the touch interface and all buttons on the student tablets will be "locked", thereby preventing the students from accessing anything on the tablet. The teacher has taken control of the tablet at this point.
Referring now to FIG. 3, messages can be transmitted using a variant Comet protocol that utilizes server-push technology to publish single-publisher multiple-listener messages in a lightweight manner. In order to be authenticated as a controllable/student tablet by the platform 12, each tablet 24 may connect to the LSS server 14 so as to subscribe to messages directed at the student, sent via a Private Channel. Each controlling device 22 authenticates as a controlling/teacher tablet checks a Locking Channel associated with his or her class to determine the current locking state.
The default state of each Private Channel and Locking Channel is a RESET message, which persists when there is no other active message on the channel. Active messages are those sent by message publishers (in this case, teachers) and persists on the channel for a configurable timeout period. Once an active message has been timed out, a RESET message is sent on that channel to reset all subscribers to their default states.
When a locking command is sent from the controlling device, i.e. when a teacher presses the lock button for his or her class, a SUBSCRIBE message is sent by the server to each student's private channel, thereby forcing each students' tablet application to subscribe to the locking channel of the class. The SUBSCRIBE message persists on all private channels for a configurable timeout period.
Once the controlling device 22, via the server 14, has forced all students to subscribe to the locking channel, a LOCK message is pushed by the server 14 on that locking channel to all subscribed students.
Once a student tablet receives a LOCK message, the tablet 24 acknowledges the message, changes display elements in the user interface to indicate that the application is being locked, and disables all input handling of the tablet platform.
Controllable tablets 24 are unlocked when they receive an UNLOCK command from the server 14, which is triggered by a controlling device 22. A RESET command can also unlock the controllable tablets.
In the alternate embodiment shown in FIG. 6, each tablet 24 connects to the LSS server 14 so as to subscribe to messages directed at the student's class, sent via the Locking Channel 52. Each controlling device 22 authenticates as a controlling/teacher tablet checks a Locking Channel associated with his or her class to determine the current locking state.
The default state of each Locking Channel 52 is a RESET message, which persists when there is no other active message on the channel. Active messages are those sent by message publishers (in this case, teachers) and persists on the channel for a configurable timeout period. Once an active message has been timed out, a RESET message is sent on that channel to reset all subscribers to their default states. The controlling device 22, pushes a LOCK message via the server 14 on that Locking Channel 52 to all subscribed students, thereby locking the interfaces of the controllable tablets 24, for students of a given class. Once a student tablet receives a LOCK message, the tablet 24 acknowledges the message, changes display elements in the user interface to indicate that the application is being locked, and disables all input handling of the tablet platform.
Controllable tablets 24 are unlocked when they receive an UNLOCK command from the server 14, which is triggered by a controlling device 22. A RESET command can also unlock the controllable tablets.
FIG. 1 A shows the home page accessible on the controlling device 22, for the teacher. This interface includes several navigation tools, at the bottom right of the interface, including a notification of the current locking state of the teacher's locking channel. In this case, the locking state is "unlock". FIG. 1 D shows a student home screen in an unlocked state. The navigation tools are different than those of the controlling device.
Referring to FIG. 1 B, when the teacher presses the "lock" button, the Lock notification changes to the locked state, and the synchronize button appears. As shown in FIG. 1 E, when the teacher presses the lock button, a student in that teacher's locking channel will receive a notification that his or her tablet is now locked. A large lock icon is displayed for a few seconds before disappearing. As shown in FIG. 1 F, after the lock notification disappears, the student's navigation icons will show only a button displaying the locked state of the tablet.
Browse course information and content Teachers are able to browse course content via their controlling device 22 (desktop, laptop, or tablet), by accessing the Learning Management System server 16, while student tablets 24 are in locked mode. The LMS server 16 preferably includes an Administration interface which allows interacting with the content stored on an external server, such as a Moodle server 20. Accessing the course content can be done via an application installed on the tablet, or via a web-browser. In other words, teachers are able to browse content, via their tablets 24, within a web browser contained within the learning management system. The teacher is able to access the learning management system (LMS) using any web browser. The teacher accesses the LMS through the "Admin Interface", which is a web-accessible interface to the LMS server.
Alternatively, teachers can access course content from the clustered servers 12 using a web browser from a desktop or desktop computer, as long as the device has been authenticated as a controlling/teacher's device.
As shown in FIG. 2, the course material and content is located within the online "cloud" LMS server 16 and stored within a database 20. The course content is preferably rendered on the teacher's device as a webpage. Preferably, it is possible to browse external Internet websites via the LMS server 16.
All content is rendered according to the templates and methods of input using the learning management system. Preferably, formatting and rendering of the data and templates are predefined, using HTML, but of course, other languages can be considered.
Referring to FIG. 1 C, a teacher can continue to browse the application, or browse through the web-based version of the application, while his or her locking channel is in the locked state. Once a teacher has selected content that should be displayed on the student's tablet, he or she can click the synchronize button, as it will be explained more in detail below.
Synch information and content
The system 10 can also allow the controlling devices 22 of teachers, once they have browsed to either course content or websites they wish to display on the student tablets, to synchronize with the students' tablets 24 by pressing a "synchronize" button (on the tablet application - if using a tablet, or via the web-based application control panel - if using a laptop) to force all the student tablets 24 that they have previously locked to load the synchronized content. Once synchronized, the controllable tablet will allow scrolling of the content of the tablet application, but will prevent any navigation away from the content. Turning now to FIG. 4, the controlling device (via either one of the Braincloud Tablet application or the Braincloud-on-the-Web) will know which content or web page the teacher has browsed by recording the page URI, content ID, or website URL selected by the teacher. When the teacher clicks on the synchronize button on his or her control panel, a REDIRECT message will be sent to the teacher's class Locking Channel with the URI, content ID, or URL as the REDIRECT argument.
The LSS server 14 will broadcast that message on the Locking Channel via a server push message to all student tablets 24 subscribing to that Locking Channel. Tablets 24 which receive a REDIRECT message and which are in a locked state will redirect the tablet view to the page URI, content ID, or website URL as specified in the message argument. The teacher may broadcast as many REDIRECT messages using the sync button as necessary during a locked session to his or her class' Locking Channel while the channel state is locked. Referring to FIG. 1 G, while in the locked state on a teacher's locking channel, a student's tablet receiving a synchronized message will immediately show the content that the teacher has synched to. The student still cannot navigate or browse, but is able to scroll the content. Once the teacher unlocks the tablets, the students are able to browse any particular course content. As shown in FIG. 1 H, the student's tablet is in the unlocked state (the lock button at the bottom right of the screen has disappeared) and he/she is able to browse any content or web page available from the application.
In accordance with the alternate embodiment shown in FIG. 7, the controlling device will know which content or web page the teacher has browsed by recording the page URI, content ID, or website URL selected by the teacher (via either one of the Braincloud Tablet application or the Braincloud-on-the-Web). The controlling device will also know the current viewport position of the content as it is being viewed by the teacher. When the teacher clicks on the synchronize button on his or her control panel, a REDIRECT message will be sent to a Redirect Channel 55 of teacher's class, with the URI, content ID, or URL, and the current viewport position of the content, as the REDIRECT argument. The LSS server 14 will broadcast that message on the Redirect Channel 55 via a server push message to all student tablets 24 subscribing to that Redirect Channel 55. Tablets 24 which receive a REDIRECT message and which are in a locked state will redirect the tablet view to the page URI, content ID, or website URL, and position the viewport of the student tablet in the exact position of the teacher's view, as specified in the message argument.
The teacher may broadcast as many REDIRECT messages using the sync button as necessary during a locked session to his or her class' Redirect Channel 55 while the channel state is locked.
While in the locked state on a teacher's locking channel, a student's tablet receiving a first synchronized message to a particular piece of content will immediately show the content that the teacher has synched to (see FIG. 1 G). The student still cannot navigate or browse, but is able to scroll the content. Any subsequent REDIRECT messages to the same piece of content which repositions the viewport according to the viewport position of the teacher, will disallow scrolling of the content by the student for a certain period of time. Once the teacher unlocks the tablets, the students are able to browse any particular course content. As shown in FIG. 1 H, the student's tablet is in the unlocked state (the lock button at the bottom right of the screen has disappeared) and he/she is able to browse any content or web page available from the application.
Subgrouping assignment
In accordance with an embodiment, with reference to FIG. 9 and 10, the LSS server is configured to allow teachers to break up a classroom's students into subgroups, allowing them to work on separate group tasks while all within the same classroom. In brief terms, a controlling tablet, once it has locked controllable tablets of a classroom, accesses an additional control screen allowing the teacher, via the controlling tablet, to create subgroups within each class. A screenshot of the control screen is shown in FIG. 9. The control screen of the user interface 32 is split into two sections 100, 102. The first section 100 (i.e. top half) shows the list of created groups and assigned students within each group, while the second section 102 (i.e. bottom half) shows the list of students within the classroom that have not yet been assigned to a group.
From this screen, a teacher may, via the controlling tablet 22 proceed with any of the following operations:
- create a new group within his or her classroom;
- drag and drop students into and out of groups by clicking and dragging on the names and profile pictures of students in the same class.
- delete a created group, thereby releasing all students within that group into the unassigned area 102;
- select a group for synchronization by clicking on the tick (the selected group will be highlighted red as shown at 104); and/or
- select the entire class for synchronization.
Group assignments for a class persist for the entire life of the classroom, i.e. as long as the classroom exists within the LMS 16, the state of student grouping will continue to exist.
If a group has been selected for locking and/or synchronization, REDIRECT messages will be sent only to that group via the modifications to the Synchronizing Information and Content method as will be better described below. The teacher may return to the control screen 32 at any time and select another group, or to select the entire class for locking and/or synchronization.
In order to allow persistence of group assignment state, a subgroup assignment webservice (SAWS) 106 allows assignment state to be saved and retrieved. Communication with the server is performed by authenticated controlling tablets via a RESTful request and response protocol. The operations allowed on SAWS 106 are:
- Registration of students into Locking Channels (classrooms) (130);
- Creation of groups within Locking Channels (classroom groups) (132);
- Assignment of students into and out of groups within a Locking Channel (134);
- Providing information on group assignments (136).
Controlling tablets 22 will query SAWS 106 upon a first lock operation 116 by the teacher. Controllable tablets 24 will query SAWS 106 once the first classroom-wide LOCK message is received 120 from a controlling tablet 22 to determine the student user's group assignment if it exists within the classroom Locking Channel 52.
Students are grouped and ungrouped within a classroom via an additional set of commands sent through the classroom's Locking Channel 52.
A controllable tablet 24, once it receives 120 a LOCK message on its Locking Channel 52, will check for its group assignment by querying SAWS 106. If it does not belong to a group, it will perform the lock functionality as previously described. However, if it does belong to a group assignment, it will also subscribe to a second Locking Group Channel 108 along with its main Locking Channel 52 which on the LSS 14.
Furthermore, if the controllable tablet 24 belongs to a group, it will also subscribe to REDIRECT messages 120 sent 118 by the controlling tablet 22 on a second Redirect Group Channel 110 along with its main Redirect Channel 55 on the LSS 14.
Commands may be sent from the controlling tablet 22 to its controllable tablets 24 via the main Locking Channel 52. The SETGROUP command 112 is sent by the controlling tablet 22 along with its parameters, a group id and a user id, and is received 124 at a controllable tablet 24 operated by a student user with that user id listening on the Lock Channel 52. The SETGROUP command 124 forces the controllable tablet 24 to subscribe to the Locking Group Channel 108 with that group id. The UNSETGROUP command 114 is sent by the controlling tablet 22 along with a user id parameter, and is received 126 at a controllable tablet 24 operated by a student user with that user id listening on the Lock Channel 52 to unsubscribe from any Locking Group Channels 108 to which it is currently subscribed. SETGROUP and UNSETGROUP commands 112, 114 may only be sent on the main Locking Channel 52, and not on the Locking Group Channel 108, in accordance with the present embodiment. A controlling tablet 22 will send messages according to the Locking Group Channel 108 or Redirect Group Channel 110 corresponding to the selected group in the group control screen 32, or to the main Locking or Redirect Channel 52, 55 if no groups are selected. Controllable tablets 24 will receive messages on the main Locking or Redirect Channel 52, 55 and on the Locking or Redirect Group Channel 108, 110, it is assigned based on the initial state received from the query to SAWS 106 or on subsequent commands sent via the LSS 14.
Of course, as explained previously, the controlling device 22 does not necessarily need to be located within the same room as the controllable tablets 24, since all communications can be made via internet connections. Students with their tablets may also be dispersed in different locations.
As it can be appreciated, the present system 10 allows for a controlling device 22 to control several computer tablets 24 simultaneously, via a remote server 12. The controlling device 22 is preferably a laptop or desktop, but it can also consist of a computer tablet or smartphone, or any similar device. The controlling device may not only lock the controllable tablets, it can also manage the content to be displayed on the tablets 24. While the preferred embodiment described herein is especially adapted for a learning management system, it is possible to use such a system for other applications, such as in the field of health care, where a doctor would be provided with the controlling device 22 and nurses or patients would be provided with the controllable tablets 24.
The learning management system 10 illustrated in FIG. 2 (also referred to herein as "tablet management system" or "system") will now be described in other terms.
The learning management system 10 shown in FIG. 2 comprises the controllable devices 24, generally intended for respective students 25. Each controllable device 24 has a user interface 32, a processor 34 for processing input commands received at the user interface 32, and a communication port 36 for communicating via a communication network 40. Each controllable device 24 further comprises a memory 38. Each controllable device 24 is operable in a locked configuration and in an unlocked configuration. The controllable devices 24 are provided by tablet computers, but may alternatively be provided by any suitable general purpose computer, portable computer, Personal digital assistant (PDA), smart phone, mobile phone, and/or the like. The user interface 32 comprises a display screen, which is a touch screen, and may alternatively or additionally comprise a regular display screen, a keyboard, a virtual keyboard, a mouse, a mouse pad, a microphone, a speaker, and/or the like. The communication port 36 enables wireless communication with the server system 12.
The system 10 further comprises a controller device 22 (also referred to in the present by "controlling device" or "controlling tablet"), generally intended for a teacher 23. The controller device 22 has a communication port 46 for sending locking and unlocking command signals, wirelessly, via the communication network 40. The controllable devices 24 may be provided by any suitable general purpose computer, tablet computer, portable computer, PDA, smart phone, mobile phone, and/or the like, and further comprises a user interface 42, a processor 44 and a memory 48. With further reference to FIG. 3, the system 10 further comprises a server system 12 for interpreting and handling communications between the controllable devices 24 and the controller device 22. More particularly, the server system 12 receives 70 the locking command signal 68 from the controller device 24, and sends in response thereto, a corresponding locking control signal 72 to operate each of the controllable devices 24 simultaneously in said locked configuration in which the user interface 32 of the controllable device 24 is controlled by the controller device 22.
In some embodiments, in the locked configuration, the user interface 32 is controlled by the controller device 22 to present learning content restricted by the controller device 22, for example a particular webpage, a particular course content, a particular lesson and/or the like, which may be provided as static readable data, or in the form of an exercise or test capable or receiving student input. The controllable device still provides some user interface control to a user, i.e. a student 25 (see FIG. 2), in that the student may scroll within the content and/or input information within the present learning content. In an example where the restricted content includes video or other recorded content, the controllable device may enable the student, in the locked configuration, to still navigate within the recorded content. Still in another example where the restricted content includes several interlinked pages, the student may be enabled, in the locked configuration, to still navigate within those pages. Thus, in the locked configuration, the processing of input commands by the processor 34 at the controllable devices 24 is restricted to respond to input commands related to the restricted learning content, in order to prevent the user of the controllable device from consuming data beyond the restricted learning content.
Moreover, with further reference to FIG. 5, the server system 12 receives 96 the unlocking command signal 94 from the controller device 22, and sends in response thereto, a corresponding unlocking control signal 97 to operate each of the controllable devices 24 from said locked configuration to the unlocked configuration 98 wherein the user interface is operable independently of the controller device, i.e. the controllable devices 24 are disengaged from the controller device 22.
The server system 12 may be provided by a plurality of servers which cooperate together to operate the system. Alternatively, the server system 12 may be provided by a single server. The server system 12 may be located on site (in the classroom or near the controller device 22, for example) or it may be located remotely from the devices 22, 24
In the embodiment shown in FIG. 2, the server system 12 comprises cloud-based clustered servers, including the Locking and Synchronization System (LSS) 14 for managing locking and unlocking of the controllable devices 24 by the controller device 22, and further including the Learning Management System (LMS) server 16 for managing authentication rights of users associated to the controllable devices 24 and for managing content to be distributed to the controllable devices 24. The cloud-based clustered servers 12 preferably include other servers represented by 18, for storing, managing statistical information, student information and/or the like. The LMS 16 server comprises an administrative interface accessible via the Internet.
The learning management system 10 further comprises a database 20 for storing the content to be distributed, the database being in communication with the server system 12 It is to be understood that the communication between the server system 12 and the different components of the system 10 (controller devices 22, the controllable devices 24, the database 20) may each be handled over different communication networks, in accordance with embodiments of the present, as a skilled reader would understand.
The term "communication network" refers to any suitable communication means and may be provided by a wide area network (WAN) such as the Internet, a local area network (LAN), a cable connection, a wireless connection, a data network, a telephone network, and/or the like.
It is to be understood that the system may comprises a plurality of controller devices 22 which cooperate to control a same group of controllable devices 24. Moreover, a plurality of controller devices 22 may be provided, each being associated to distinct groups of controllable devices 24, i.e. different smart classrooms. Still alternatively, a same controller device 22 may operate for a given set of controllable devices 24 at a given time, and with one or more other sets at other times.
Operational features of the learning management system 10 will now be described in other terms, with reference to FIG. 3 to 5, in accordance with the first embodiment.
A method 50 of authenticating and locking is shown in FIG. 3. Upon receiving an authentication request 60 from one of the controllable devices 24, the LSS server 14 connects the controllable device 24 to the LSS server 14 via a corresponding Private Channel 54 and sets a default state on the Private Channel 54, i.e. send a RESET message on the Private Channel 52, as shown at bloc 62.
Upon receiving an authentication request 64 from the controller devices 22, the LSS server 14 connects the controller device 22 to the LSS server 14 via the Locking Channel 52 and sets a default state on the Locking Channel 52, i.e. send a RESET message on the Locking Channel 52, as shown at bloc 66. When the LSS server 14 (a) receives 70 a locking command signal 68 from the controller device 22, the LSS server 14 (b) processes the locking command signal 68 and sends a corresponding locking control signal to controllable devices 24. More particularly, the LSS server 14 sends a SUBSCRIBE message 72 on the private channels 54 to force each controllable device to subscribe to the locking channel; and then sends a LOCK message 78 on the locking channel 52 to be received 80 by the respective controllable devices 24, in order to simultaneously operate each of the controllable devices 24 in the locked configuration.
A method 56 of synchronizing the controllable device 24 with the controller device 22 is shown in FIG. 4. When the controllable devices 24 are in the locked configuration, the learning content to be distributed to the controllable devices 24 is selected 82 at the controller device 22, which is then synchronized with the controllable devices 24 to force the controllable devices 24 to load the selected learning content. More particularly, the synchronizing comprises receiving 86 at the LSS server 14 a content identifier being associated to the learning content having been selected and having been sent 84 by the controller device 22; and upon receiving a synchronize command signal 88 from the controller device 22, sending 90 a REDIRECT message and the content identifier on the locking channel 52, in order to present 92, on the user interface of each controllable device 24, the selected learning content based on the content identifier. The steps for unlocking 58 the controllable devices 24 is shown in FIG. 5. The controller device 22 sends 94 an unlocking command signal which is received 96 at the LSS server 14. In response thereto, the LSS server 14 sets 97 the Private and Locking Channels 52, 54 to a default status, i.e. by sending a RESET message which is received 98 at the controllable devices 24, in order to operate simultaneously each of the controllable devices from the locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device.
Operational features of the system will now be described in accordance with the second embodiment, with reference to FIG. 6 to 8.
With reference to FIG. 6 which illustrates the method 50 of authenticating and locking, upon receiving an authentication request 60 from one of the controllable devices 24, the LSS server 14 connects the controllable device 24 to the LSS server 14 on the Locking Channel 52 requested by the controllable device 24, depending on the enrollment status of the student using the controllable device 24 as specified on the LMS 16.
Upon receiving an authentication request 64 from the controller devices 22, the LSS server 14 connects the controller device 22 to the LSS server 14 via the Locking Channel 52 and sets a default state on the Locking Channel 52, i.e. send a RESET message on the Locking Channel 52, as shown at bloc 66.
When the LSS server 14 (a) receives 70 a locking command signal 68 from the controller device 22, the LSS server 14 (b) processes the locking command signal 68 and sends a corresponding locking control signal to controllable devices 24. More particularly, the LSS server 14 sends a LOCK message 78 on the locking channel 52 to be received 80 by the respective controllable devices 24, in order to simultaneously operate each of the controllable devices 24 in the locked configuration.
A method 56 of synchronizing the controllable device 24 with the controller device 22, in the context of the second embodiment is shown in FIG. 7. When the controllable devices 24 are in the locked configuration, the learning content to be distributed to the controllable devices 24 is selected 82 at the controller device 22, which is then synchronized with the controllable devices 24 to force the controllable devices 24 to load the selected learning content. More particularly, the synchronizing comprises receiving 86 at the LSS server 14 a content identifier being associated to the learning content having been selected and having been sent 84 by the controller device 22; and upon receiving a synchronize command signal 88 from the controller device 22, sending 90 a REDIRECT message and the content identifier on the redirect channel 54, in order to present 92, on the user interface of each controllable device 24, the selected learning content based on the content identifier. With reference to FIG. 8 which illustrates the method of unlocking 58, the controller device 22 sends 94 an unlocking command signal which is received 96 at the LSS server 14. In response thereto, the LSS server 14 sets 97 the Locking Channel 52 to a default status, i.e. by sending a RESET message which is received 98 at the controllable devices 24, in order to operate simultaneously each of the controllable devices from the locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device. Various optional scenarios and examples
Various optional scenarios and examples of the system, the method, and features thereof will be described below. It should be understood that the scenarios described below may be combined with other aspects of the learning management system as described hereinabove, or with features thereof, in accordance with various embodiments of the present invention.
According to some scenarios, there is provided a learning management system comprising: controllable devices, each having a user interface, a processor for processing input commands received at the user interface, and a communication port for communicating via a communication network, each controllable device being operable in a locked configuration and in an unlocked configuration; and a controller device having a communication port: for sending a locking command signal to the controllable devices via the communication network, in order to operate each of the controllable devices in said locked configuration wherein the user interface is controlled to present learning content restricted by the controller device and wherein the processor is restricted to respond to input commands related to the restricted learning content; and for further sending an unlocking command signal to the controllable devices via a communication network, in order to operate each of the controllable devices from said locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device. An input command may be defined as a user input or user command entered at the controllable device, and preferably includes a scrolling command to allow independent scrolling at each device within the viewable learning content, and may also include editing, for example filing out an exercise or test. In other words, in the locked configuration, the user interface is responsive to user commands performed within the restricted learning content. Preferably, at least one or more of said controllable devices and of said controller device is provided by a tablet computer. According to another scenario, there is provided a method of operating a learning management system comprising: (a) sending a locking command signal to controllable devices in order to operate each of the controllable devices in said locked configuration wherein a user interface of each controllable device is controlled to present learning content restricted by a controller device and wherein the processor is restricted to respond to input commands related to the restricted learning content. The method further comprises (b) sending an unlocking command signal to controllable devices in order to operate each of the controllable devices in said unlocked configuration wherein the user interface is operable independently of the controller device. Preferably, the user interface of each controllable device comprises a display screen, the learning content being displayed on the display screen, and wherein the input commands related to the restricted learning content include scrolling within the learning content displayed.
According to yet another scenario, there is provided a non-transitory storage medium comprising processor-readable data and instructions for sending a locking command signal to controllable devices in order to operate each of the controllable devices in said locked configuration wherein a user interface of each controllable device is controlled to present learning content restricted by a controller device and wherein the processor is restricted to respond to input commands related to the restricted learning content. The non-transitory storage medium further comprises processor-readable data and instructions for sending an unlocking command signal to controllable devices in order to operate each of the controllable devices in said unlocked configuration wherein the user interface is operable independently of the controller device. According to another scenario, there is provided a tablet management system. The system comprises:
- at least one server with authenticating and administrative capabilities;
- several controllable tablets, each provided with a processor, a memory, a touchscreen for displaying an interface, and wireless connection capabilities for communicating with said at least one server, and
- a controlling device provided with a processor, a memory, a screen for displaying a controlling interface, and wireless connection capabilities for communicating with said at least one server,
the server being able to authenticate the controlling device and controllable tablets, and the controller device being adapted to control simultaneously the controllable tablets through the controllable interface.
In one embodiment, the tablet management system is a learning management system.
In one embodiment of the system, the controlling device controls the controllable tablets via the server.
In one embodiment, the controlling device is one of: a tablet, a laptop, a desktop, or any other device able to access the at least one server through a secure web interface.
In one embodiment, the controlling interface is a web-page accessible through a web browser, while in another embodiment, the controlling interface is an application stored within the controlling PC or tablet memory.
In one embodiment of the system, the controlling device comprises means for locking and/or synchronizing the tablets.
In one embodiment of the system, the at least one server comprises several cloud- based clustered servers. In one embodiment of the system, the cloud-based clustered servers include a Locking and Synchronization System (LSS) and Learning Management System (LMS) server. In one embodiment of the system, the tablets include web-browsing capabilities.
In one embodiment of the system, the tablets include an application for displaying and interacting with learning content stored on the at least one server. In one embodiment, the authenticating capabilities allow creating a locking channel with the controller tablet and a private channel with each of the controllable tablet.
In an alternate embodiment, the authenticating capabilities allow creating a locking channel with the controller tablet and a redirect channel with each of the controllable tablet.
According to still another scenario, a method for managing several tablets simultaneously is provided. The method comprises the steps of:
- Providing a Learning Management System including at least one server, a controlling device, and several controllable tablets;
- Establishing communication between each of the tablets, the controlling device and the server, and authenticating the controlling device and controllable tablets as such,
- Upon receiving a lock command by the controlling device, simultaneously locking the controllable tablets.
In one embodiment, the method further comprises a step of synchronizing learning content to be displayed on the controllable tablets. Although preferred embodiments of the present invention have been described in detail herein and illustrated in the accompanying drawings, it is to be understood that the invention is not limited to these precise embodiments and that various changes and modifications may be effected therein without departing from the present invention.

Claims

CLAIMS:
1 . A learning management system comprising:
- controllable devices, each having a user interface, a processor for processing input commands received at the user interface, and a communication port for communicating via a communication network, each controllable device being operable in a locked configuration and in an unlocked configuration; and
- a controller device having a communication port for sending locking and unlocking command signals via the communication network; and
- a server system for interpreting and handling communications between the controllable devices and the controller device, in order to:
- receive the locking command signal from the controller device, and send in response thereto, a corresponding locking control signal to operate each of the controllable devices simultaneously in said locked configuration wherein the user interface of the controllable device is controlled by the controller device, and
- receive the unlocking command signal from the controller device, and send in response thereto, a corresponding unlocking control signal to operate each of the controllable devices from said locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device.
2. The learning management system according to claim 1 , wherein the server system comprises cloud-based clustered servers.
3. The learning management system according to claim 1 , wherein the server system comprises a Locking and Synchronization System (LSS) for managing locking and unlocking of the controllable devices by the controller device.
4. The learning management system according to claim 1 , wherein the server system comprises a Learning Management System (LMS) server for managing authentication rights of users associated to the controllable devices and for managing content to be distributed to the controllable devices.
5. The learning management system according to claim 4, wherein the Learning Management System (LMS) server comprises an administrative interface accessible via the Internet.
6. The learning management system according to claim 1 , further comprising a database for storing the content to be distributed, the database being in communication with the server system.
7. The learning management system according to claim 1 , wherein at least one or more of said controllable devices and of said controller device is provided by a tablet computer.
8. A method of operating a learning management system comprising:
a) receiving, at a server system, a locking command signal from a controller device; and
b) processing, at the server system, the locking command signal and sending a corresponding locking control signal to controllable devices in order to simultaneously operate each of the controllable devices in said locked configuration wherein a user interface of each controllable device is controlled by the controller device.
9. The method according to claim 8, further comprising:
c) receiving an unlocking command signal from a controller device; and d) processing the unlocking command signal and sending a corresponding unlocking control signal to the controllable devices in order to operate simultaneously each of the controllable devices from the locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device.
10. The method according to claim 8, further comprising prior to step (a) authenticating the controllable devices and the controller device.
1 1 . The method according to claim 10, wherein the authenticating comprises:
- connecting the controller device to a server system via a locking channel; and
- connecting each of the controllable devices to the server system via a corresponding private channel, so as to subscribe each controllable device to messages directed the respective controllable device.
12. The method according to claim 1 1 , further comprising prior to step (a), at the server system:
- setting a default state on the locking channel;
- setting a default state on the respective private channels; and
wherein step (b) comprises, at the server system:
- sending a corresponding SUBSCRIBE message on the private channels to force each controllable device to subscribe to the locking channel; and
- sending a LOCK message on the locking channel in order to operate each of the controllable devices in the locked configuration.
13. The method according to claim 12, wherein step (d) comprises, at the server system:
- setting a default state on the locking channel; and
- setting a default state on the respective private channels.
14. The method according to claim 12, further comprising, when the controllable devices are in the locked configuration:
- selecting, at the controller device, the learning content to be distributed to the controllable devices; and
- synchronizing the controller device with the controllable devices to force the controllable devices to load the selected learning content.
15. The method according to claim 14, wherein the synchronizing comprises, at the server system:
- receiving a content identifier being associated to the learning content having been selected; and
- upon receiving a synchronize command signal from the controlling tablet, sending a REDIRECT message and the content identifier on the locking channel, in order to present, on the user interface of each controllable device, the selected learning content based on the content identifier.
16. The method according to claim 15, wherein the locked configuration of each controllable device restricts the processor to respond to input commands related to the restricted learning content.
17. The method according to claim 16, wherein the user interface of each controllable device comprises a display screen, the learning content being displayable on the display screen when the controllable device is in the locked configuration, and wherein the input commands related to the restricted learning content include scrolling within the learning content displayed.
18. A non-transitory storage medium comprising processor-readable data and instructions for receiving, at a server system, a locking command signal from a controller device, for processing the locking command signal and for sending a corresponding locking control signal to controllable devices in order to operate simultaneously each of the controllable devices in said locked configuration wherein a user interface of each controllable device is controlled by the controller device.
The non-transitory storage medium according to claim 18, further comprising processor-readable data and instructions for receiving an unlocking command signal from a controller device, for processing the unlocking command signal and for sending a corresponding unlocking control signal to the controllable devices in order to operate simultaneously each of the controllable devices from the locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device.
A learning management system comprising:
- controllable devices, each having a user interface, a processor for processing input commands received at the user interface, and a communication port for communicating via a communication network, each controllable device being operable in a locked configuration and in an unlocked configuration; and
- a controller device having a communication port for sending locking and unlocking command signals via the communication network and for sending control command signals; and
- a server system for interpreting and handling communications between the controllable devices and the controller device, in order to:
- receive the locking command signal from the controller device, and send in response thereto, a corresponding locking control signal to operate each of the controllable devices simultaneously in said locked configuration wherein the user interface of the controllable device is controlled by the server in response to the control command signals received at the server from the controller device, and
- receive the unlocking command signal from the controller device, and send in response thereto, a corresponding unlocking control signal to operate each of the controllable devices from said locked configuration to the unlocked configuration wherein the user interface is operable independently of the controller device.
A method of operating a learning management system comprising:
a) receiving, at a server system, a locking command signal from a controller device; and
b) processing, at the server system, the locking command signal and sending a corresponding locking control signal to controllable devices in order to simultaneously operate each of the controllable devices in said locked configuration wherein a user interface of each controllable device is controlled by the server in response to the control command signals received at the server from the controller device.
A learning management system comprising:
- a controller device having a communication port for sending control command signals relative to learning content;
- a server system being capable of communicating with the controller device for interpreting the control command signals and sending corresponding command signals; and
- controllable devices, each having a user interface, a processor for processing input commands received at the user interface, and a communication port for communicating via a communication network with the server system, each controllable device being operable: - in a locked configuration wherein the user interface is controlled to present the learning content in accordance with the control signals, and
- in an unlocked configuration wherein the user interface is operable independently of the server system.
A learning management system comprising:
- a controller device having a communication port for sending control command signals relative to learning content;
- a server system being capable of communicating with the controller device for interpreting the control command signals and sending corresponding command signals; and
- controllable devices, each having a user interface, a processor for processing input commands received at the user interface, and a communication port for communicating via a communication network with the server system, each controllable device being operable:
- in a locked configuration wherein the user interface is controlled to present the learning content in accordance with the control signals.
A method of operating a learning management system comprising:
a) receiving, at a server system, a control command signal from a controller device, control command signal being associated to learning content; and
b) processing, at the server system, the locking command signal and sending a corresponding control signal to controllable devices in order to simultaneously operate each of the controllable devices in a locked configuration wherein a user interface of each controllable device is controlled to present the learning content in accordance with the control signals received from the server system.
25. The method according to claim 24, wherein the control command signal comprises a pointer to the learning content and wherein the control signal is interpreted at the user interface to display the learning content referred to by the pointer.
26. The method according to claim 24, wherein the control command signal comprises a user interface permission and wherein the control signal is interpreted at the controllable device to respond to user interface commands based on the user interface permissions defined by the controller device.
27. The method according to claim 26, wherein the user interface commands to which the controllable device responds comprises at least one of: annotating the learning content; scrolling within the learning content; editing the learning content; browsing pages of the learning content; navigating within the learning content; and communicating with other devices in the context of the learning content.
28. The method according to claim 24, wherein the learning content comprises at least one of: text data, image data, video data, sound data, hyperlink data, active link data, and executable application data.
PCT/CA2013/050894 2012-11-22 2013-11-22 System and method for managing several mobile devices simultaneously WO2014078965A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CA2892614A CA2892614C (en) 2012-11-22 2013-11-22 System and method for managing several mobile devices simultaneously
US14/646,797 US9756049B2 (en) 2012-11-22 2013-11-22 System and method for managing several mobile devices simultaneously

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201261729388P 2012-11-22 2012-11-22
US61/729,388 2012-11-22
US201361791233P 2013-03-15 2013-03-15
US61/791,233 2013-03-15

Publications (1)

Publication Number Publication Date
WO2014078965A1 true WO2014078965A1 (en) 2014-05-30

Family

ID=50775358

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2013/050894 WO2014078965A1 (en) 2012-11-22 2013-11-22 System and method for managing several mobile devices simultaneously

Country Status (3)

Country Link
US (1) US9756049B2 (en)
CA (1) CA2892614C (en)
WO (1) WO2014078965A1 (en)

Cited By (202)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016025036A1 (en) * 2014-08-15 2016-02-18 Apple Inc. Authenticated device used to unlock another device
US9324067B2 (en) 2014-05-29 2016-04-26 Apple Inc. User interface for payments
US9547419B2 (en) 2014-09-02 2017-01-17 Apple Inc. Reduced size configuration interface
US9548050B2 (en) 2010-01-18 2017-01-17 Apple Inc. Intelligent automated assistant
US9575591B2 (en) 2014-09-02 2017-02-21 Apple Inc. Reduced-size interfaces for managing alerts
US9574896B2 (en) 2015-02-13 2017-02-21 Apple Inc. Navigation user interface
US9584758B1 (en) 2015-11-25 2017-02-28 International Business Machines Corporation Combining installed audio-visual sensors with ad-hoc mobile audio-visual sensors for smart meeting rooms
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
US9620104B2 (en) 2013-06-07 2017-04-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9626955B2 (en) 2008-04-05 2017-04-18 Apple Inc. Intelligent text-to-speech conversion
US9633660B2 (en) 2010-02-25 2017-04-25 Apple Inc. User profiling for voice input processing
US9633674B2 (en) 2013-06-07 2017-04-25 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US9646614B2 (en) 2000-03-16 2017-05-09 Apple Inc. Fast, language-independent method for user authentication by voice
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US9668024B2 (en) 2014-06-30 2017-05-30 Apple Inc. Intelligent automated assistant for TV user interactions
US9684394B2 (en) 2011-01-10 2017-06-20 Apple Inc. Button functionality
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
EP3189434A1 (en) * 2014-09-04 2017-07-12 Microsoft Technology Licensing, LLC Discovery and control of remote media sessions
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9798393B2 (en) 2011-08-29 2017-10-24 Apple Inc. Text correction processing
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US9847999B2 (en) 2016-05-19 2017-12-19 Apple Inc. User interface for a device requesting remote authorization
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9916075B2 (en) 2015-06-05 2018-03-13 Apple Inc. Formatting content for a reduced-size user interface
US9930157B2 (en) 2014-09-02 2018-03-27 Apple Inc. Phone user interface
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9953088B2 (en) 2012-05-14 2018-04-24 Apple Inc. Crowd sourcing information to fulfill user requests
US9967401B2 (en) 2014-05-30 2018-05-08 Apple Inc. User interface for phone call routing among devices
US9966068B2 (en) 2013-06-08 2018-05-08 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US9971774B2 (en) 2012-09-19 2018-05-15 Apple Inc. Voice-based media searching
US10001817B2 (en) 2013-09-03 2018-06-19 Apple Inc. User interface for manipulating user interface objects with magnetic properties
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10055121B2 (en) 2015-03-07 2018-08-21 Apple Inc. Activity based thresholds and feedbacks
US10066959B2 (en) 2014-09-02 2018-09-04 Apple Inc. User interactions for a mapping application
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US10079014B2 (en) 2012-06-08 2018-09-18 Apple Inc. Name recognition system
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10083690B2 (en) 2014-05-30 2018-09-25 Apple Inc. Better resolution when referencing to concepts
US10089072B2 (en) 2016-06-11 2018-10-02 Apple Inc. Intelligent device arbitration and control
US10097496B2 (en) 2012-05-09 2018-10-09 Apple Inc. Electronic mail user interface
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US10102359B2 (en) 2011-03-21 2018-10-16 Apple Inc. Device access using voice authentication
US10108612B2 (en) 2008-07-31 2018-10-23 Apple Inc. Mobile device having human language translation capability with positional feedback
US10114521B2 (en) 2014-09-02 2018-10-30 Apple Inc. Multi-dimensional object rearrangement
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US10142835B2 (en) 2011-09-29 2018-11-27 Apple Inc. Authentication with secondary approver
US10169329B2 (en) 2014-05-30 2019-01-01 Apple Inc. Exemplar-based natural language processing
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US10185542B2 (en) 2013-06-09 2019-01-22 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10216351B2 (en) 2015-03-08 2019-02-26 Apple Inc. Device configuration user interface
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10235014B2 (en) 2012-05-09 2019-03-19 Apple Inc. Music user interface
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US10254948B2 (en) 2014-09-02 2019-04-09 Apple Inc. Reduced-size user interfaces for dynamically updated application overviews
US10269345B2 (en) 2016-06-11 2019-04-23 Apple Inc. Intelligent task discovery
US10281999B2 (en) 2014-09-02 2019-05-07 Apple Inc. Button functionality
US10283110B2 (en) 2009-07-02 2019-05-07 Apple Inc. Methods and apparatuses for automatic speech recognition
CN109743394A (en) * 2019-01-08 2019-05-10 李特 Intelligence desktop device, system and its broadcasting based on remote interaction, test method
US10297253B2 (en) 2016-06-11 2019-05-21 Apple Inc. Application integration with a digital assistant
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US10313506B2 (en) 2014-05-30 2019-06-04 Apple Inc. Wellness aggregator
US10318871B2 (en) 2005-09-08 2019-06-11 Apple Inc. Method and apparatus for building an intelligent automated assistant
US10332518B2 (en) 2017-05-09 2019-06-25 Apple Inc. User interface for correcting recognition errors
US10332079B2 (en) 2015-06-05 2019-06-25 Apple Inc. User interface for loyalty accounts and private label accounts for a wearable device
US10339293B2 (en) 2014-08-15 2019-07-02 Apple Inc. Authenticated device used to unlock another device
US10354011B2 (en) 2016-06-09 2019-07-16 Apple Inc. Intelligent automated assistant in a home environment
US10356243B2 (en) 2015-06-05 2019-07-16 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US10381016B2 (en) 2008-01-03 2019-08-13 Apple Inc. Methods and apparatus for altering audio output signals
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
US10403283B1 (en) 2018-06-01 2019-09-03 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10410637B2 (en) 2017-05-12 2019-09-10 Apple Inc. User-specific acoustic models
CN110223543A (en) * 2019-05-16 2019-09-10 泰山医学院 A kind of colleges and universities' wisdom interactive teaching and learning system
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US10452253B2 (en) 2014-08-15 2019-10-22 Apple Inc. Weather user interface
US10466883B2 (en) 2015-03-02 2019-11-05 Apple Inc. Screenreader user interface
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10482874B2 (en) 2017-05-15 2019-11-19 Apple Inc. Hierarchical belief states for digital assistants
US10484384B2 (en) 2011-09-29 2019-11-19 Apple Inc. Indirect authentication
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10496705B1 (en) 2018-06-03 2019-12-03 Apple Inc. Accelerated task performance
US10497365B2 (en) 2014-05-30 2019-12-03 Apple Inc. Multi-command single utterance input method
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10521466B2 (en) 2016-06-11 2019-12-31 Apple Inc. Data driven natural language event detection and classification
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10643611B2 (en) 2008-10-02 2020-05-05 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US10649622B2 (en) 2012-05-09 2020-05-12 Apple Inc. Electronic message user interface
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10684703B2 (en) 2018-06-01 2020-06-16 Apple Inc. Attention aware virtual assistant dismissal
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10699717B2 (en) 2014-05-30 2020-06-30 Apple Inc. Intelligent assistant for home automation
US10714117B2 (en) 2013-02-07 2020-07-14 Apple Inc. Voice trigger for a digital assistant
CN111428993A (en) * 2020-03-20 2020-07-17 上海乂学教育科技有限公司 Remote teaching system based on cloud computing
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
US10733993B2 (en) 2016-06-10 2020-08-04 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10741185B2 (en) 2010-01-18 2020-08-11 Apple Inc. Intelligent automated assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10748546B2 (en) 2017-05-16 2020-08-18 Apple Inc. Digital assistant services based on device capabilities
US10755703B2 (en) 2017-05-11 2020-08-25 Apple Inc. Offline personal assistant
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
US10791176B2 (en) 2017-05-12 2020-09-29 Apple Inc. Synchronization and task delegation of a digital assistant
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
US10789945B2 (en) 2017-05-12 2020-09-29 Apple Inc. Low-latency intelligent automated assistant
US10795541B2 (en) 2009-06-05 2020-10-06 Apple Inc. Intelligent organization of tasks items
US10810274B2 (en) 2017-05-15 2020-10-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10839159B2 (en) 2018-09-28 2020-11-17 Apple Inc. Named entity normalization in a spoken dialog system
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
US10992795B2 (en) 2017-05-16 2021-04-27 Apple Inc. Methods and interfaces for home media control
US10996917B2 (en) 2019-05-31 2021-05-04 Apple Inc. User interfaces for audio media control
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US11010127B2 (en) 2015-06-29 2021-05-18 Apple Inc. Virtual assistant for media playback
US11010561B2 (en) 2018-09-27 2021-05-18 Apple Inc. Sentiment prediction from textual data
US11023513B2 (en) 2007-12-20 2021-06-01 Apple Inc. Method and apparatus for searching using an active ontology
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US11037150B2 (en) 2016-06-12 2021-06-15 Apple Inc. User interfaces for transactions
US11070949B2 (en) 2015-05-27 2021-07-20 Apple Inc. Systems and methods for proactively identifying and surfacing relevant content on an electronic device with a touch-sensitive display
US11069336B2 (en) 2012-03-02 2021-07-20 Apple Inc. Systems and methods for name pronunciation
US11080012B2 (en) 2009-06-05 2021-08-03 Apple Inc. Interface for a virtual digital assistant
US11120372B2 (en) 2011-06-03 2021-09-14 Apple Inc. Performing actions associated with task items that represent tasks to perform
US11133008B2 (en) 2014-05-30 2021-09-28 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US11140099B2 (en) 2019-05-21 2021-10-05 Apple Inc. Providing message response suggestions
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US11144624B2 (en) 2018-01-22 2021-10-12 Apple Inc. Secure login with authentication based on a visual representation of data
US11170166B2 (en) 2018-09-28 2021-11-09 Apple Inc. Neural typographical error modeling via generative adversarial networks
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US11217251B2 (en) 2019-05-06 2022-01-04 Apple Inc. Spoken notifications
US11227589B2 (en) 2016-06-06 2022-01-18 Apple Inc. Intelligent list reading
US11231904B2 (en) 2015-03-06 2022-01-25 Apple Inc. Reducing response latency of intelligent automated assistants
US11237797B2 (en) 2019-05-31 2022-02-01 Apple Inc. User activity shortcut suggestions
US11269678B2 (en) 2012-05-15 2022-03-08 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US11283916B2 (en) 2017-05-16 2022-03-22 Apple Inc. Methods and interfaces for configuring a device in accordance with an audio tone signal
US11289073B2 (en) 2019-05-31 2022-03-29 Apple Inc. Device text to speech
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
US11314370B2 (en) 2013-12-06 2022-04-26 Apple Inc. Method for extracting salient dialog usage from live data
US11350253B2 (en) 2011-06-03 2022-05-31 Apple Inc. Active transport based notifications
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US11360641B2 (en) 2019-06-01 2022-06-14 Apple Inc. Increasing the relevance of new available information
US11388291B2 (en) 2013-03-14 2022-07-12 Apple Inc. System and method for processing voicemail
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
US11392291B2 (en) 2020-09-25 2022-07-19 Apple Inc. Methods and interfaces for media control with dynamic feedback
US11423908B2 (en) 2019-05-06 2022-08-23 Apple Inc. Interpreting spoken requests
US11431836B2 (en) 2017-05-02 2022-08-30 Apple Inc. Methods and interfaces for initiating media playback
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US11467802B2 (en) 2017-05-11 2022-10-11 Apple Inc. Maintaining privacy of personal information
US11468282B2 (en) 2015-05-15 2022-10-11 Apple Inc. Virtual assistant in a communication session
US11475898B2 (en) 2018-10-26 2022-10-18 Apple Inc. Low-latency multi-speaker speech recognition
US11475884B2 (en) 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11488406B2 (en) 2019-09-25 2022-11-01 Apple Inc. Text detection using global geometry estimators
US11495218B2 (en) 2018-06-01 2022-11-08 Apple Inc. Virtual assistant operation in multi-device environments
US11496600B2 (en) 2019-05-31 2022-11-08 Apple Inc. Remote execution of machine-learned models
US11532306B2 (en) 2017-05-16 2022-12-20 Apple Inc. Detecting a trigger of a digital assistant
US11539831B2 (en) 2013-03-15 2022-12-27 Apple Inc. Providing remote interactions with host device using a wireless device
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US11620103B2 (en) 2019-05-31 2023-04-04 Apple Inc. User interfaces for audio media control
US11638059B2 (en) 2019-01-04 2023-04-25 Apple Inc. Content playback on multiple devices
US11657813B2 (en) 2019-05-31 2023-05-23 Apple Inc. Voice identification in digital assistant systems
US11671920B2 (en) 2007-04-03 2023-06-06 Apple Inc. Method and system for operating a multifunction portable electronic device using voice-activation
US11683408B2 (en) 2017-05-16 2023-06-20 Apple Inc. Methods and interfaces for home media control
US11696060B2 (en) 2020-07-21 2023-07-04 Apple Inc. User identification using headphones
US11755276B2 (en) 2020-05-12 2023-09-12 Apple Inc. Reducing description length based on confidence
US11765209B2 (en) 2020-05-11 2023-09-19 Apple Inc. Digital assistant hardware abstraction
US11790914B2 (en) 2019-06-01 2023-10-17 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
US11798547B2 (en) 2013-03-15 2023-10-24 Apple Inc. Voice activated device for use with a voice-based digital assistant
US11809483B2 (en) 2015-09-08 2023-11-07 Apple Inc. Intelligent automated assistant for media search and playback
US11838734B2 (en) 2020-07-20 2023-12-05 Apple Inc. Multi-device audio adjustment coordination
US11847378B2 (en) 2021-06-06 2023-12-19 Apple Inc. User interfaces for audio routing
US11853536B2 (en) 2015-09-08 2023-12-26 Apple Inc. Intelligent automated assistant in a media environment
US11886805B2 (en) 2015-11-09 2024-01-30 Apple Inc. Unconventional virtual assistant interactions
US11907013B2 (en) 2014-05-30 2024-02-20 Apple Inc. Continuity of applications across devices
US11914848B2 (en) 2020-05-11 2024-02-27 Apple Inc. Providing relevant data items based on context
US11954405B2 (en) 2022-11-07 2024-04-09 Apple Inc. Zero latency digital assistant

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9990509B2 (en) * 2011-11-11 2018-06-05 Rockwell Automation Technologies, Inc. Systems and methods for error detection and diagnostics visualization
KR102109578B1 (en) * 2013-11-11 2020-05-28 삼성전자주식회사 User terminal device, method and network system for displaying webpage
CA2881644C (en) * 2014-03-31 2023-01-24 Smart Technologies Ulc Defining a user group during an initial session
US20150287329A1 (en) * 2014-04-03 2015-10-08 Edward J. Bevenour, JR. Integrated Touch Desk System
US9998914B2 (en) 2014-04-16 2018-06-12 Jamf Software, Llc Using a mobile device to restrict focus and perform operations at another mobile device
US9647897B2 (en) 2014-08-20 2017-05-09 Jamf Software, Llc Dynamic grouping of managed devices
US9886591B2 (en) 2015-02-10 2018-02-06 International Business Machines Corporation Intelligent governance controls based on real-time contexts
US9519719B2 (en) * 2015-02-10 2016-12-13 International Business Machines Corporation Resource management in a presentation environment
US11171941B2 (en) 2015-02-24 2021-11-09 Nelson A. Cicchitto Mobile device enabled desktop tethered and tetherless authentication
US10735404B2 (en) 2015-02-24 2020-08-04 Avatier Corporation Aggregator technology without usernames and passwords implemented in a service store
US11122034B2 (en) 2015-02-24 2021-09-14 Nelson A. Cicchitto Method and apparatus for an identity assurance score with ties to an ID-less and password-less authentication system
US10432615B2 (en) 2015-02-24 2019-10-01 Avatier Corporation Aggregator technology without usernames and passwords implemented in unified risk scoring
US9686273B2 (en) * 2015-02-24 2017-06-20 Avatier Corporation Aggregator technology without usernames and passwords
US10848485B2 (en) 2015-02-24 2020-11-24 Nelson Cicchitto Method and apparatus for a social network score system communicably connected to an ID-less and password-less authentication system
US10438177B2 (en) * 2015-06-15 2019-10-08 Worldpay, Llc System and method for third party payment at point of sale terminals
US10169553B2 (en) * 2015-06-29 2019-01-01 Airwatch, Llc Managing grouped student devices with timed locks
CN107731026A (en) * 2017-10-31 2018-02-23 杭州迈杰教育科技有限公司 A kind of intelligent tutoring mobile management system based on Internet of Things
US10908933B1 (en) * 2019-12-05 2021-02-02 Microsoft Technology Licensing, Llc Brokerage tool for accessing cloud-based services
CN111862708B (en) * 2020-07-09 2022-04-19 国网天津市电力公司 Regulation and control training simulation method suitable for simultaneous examination of multiple persons
US11334662B2 (en) * 2020-07-14 2022-05-17 Bank Of America Corporation Tamper-evident travel devices equipped with secure re-image file (s)
CN112951017A (en) * 2021-01-29 2021-06-11 秦皇岛职业技术学院 Interactive projection blackboard for mathematical education and use method thereof
CN113282900A (en) * 2021-05-20 2021-08-20 读书郎教育科技有限公司 Intelligent desk lamp capable of unlocking student tablet and method
US20220406210A1 (en) * 2021-06-21 2022-12-22 Roots For Education Llc Automatic generation of lectures derived from generic, educational or scientific contents, fitting specified parameters

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102509482A (en) * 2011-11-15 2012-06-20 北京瑞信在线系统技术有限公司 Multimedia teaching system based on mobile terminal framework

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4652240A (en) 1984-11-13 1987-03-24 Wackym Phillip A Interactive training system
US4715818A (en) 1984-12-04 1987-12-29 Ronald Lewis Shapiro Computer training system
US4785472A (en) 1987-05-11 1988-11-15 The Trustees Of The Stevens Institute Of Technology Remote teaching system
JP2734429B2 (en) * 1995-10-26 1998-03-30 日本電気株式会社 Radio selective call receiver
US6359944B1 (en) * 1996-04-17 2002-03-19 Thomson Licensing S.A. Tuning system for achieving quick acquisition times for a digital satellite receiver
US6041394A (en) * 1997-09-24 2000-03-21 Emc Corporation Disk array write protection at the sub-unit level
US6411796B1 (en) 1997-11-14 2002-06-25 Sony Corporation Computer assisted learning system
US6163276A (en) * 1999-05-17 2000-12-19 Cellnet Data Systems, Inc. System for remote data collection
US6477558B1 (en) * 1999-05-17 2002-11-05 Schlumberger Resource Management Systems, Inc. System for performing load management
US7203457B1 (en) * 1999-07-19 2007-04-10 Thomson Licensing Tuning system for achieving rapid signal acquisition for a digital satellite receiver
US6928260B2 (en) 2001-04-10 2005-08-09 Childcare Education Institute, Llc Online education system and method
US7210938B2 (en) * 2001-05-09 2007-05-01 K12.Com System and method of virtual schooling
EP1430631A4 (en) * 2001-08-23 2009-01-21 Bamboo Mediacasting Ltd Multicast transmission in packet based cellular networks
KR20050072423A (en) 2002-09-25 2005-07-11 라 미나 이퀴티즈 코포레이션 Electronic training systems and methods
US20060147891A1 (en) 2004-12-16 2006-07-06 Ricardo Dreyfous Education management system including lesson plan file compilation
JP2007052148A (en) 2005-08-17 2007-03-01 Jr Shikoku Communication Ware:Kk Learning support system
US20080318199A1 (en) 2007-06-20 2008-12-25 Crouch Douglas A Computer systems and method for educational use
US8200836B2 (en) * 2007-11-16 2012-06-12 Microsoft Corporation Durable exactly once message delivery at scale
US8358963B2 (en) 2007-12-05 2013-01-22 At&T Intellectual Property I, L.P. Methods, systems, and computer program products for interactive presentation of educational content and related devices
US8464063B2 (en) * 2010-03-10 2013-06-11 Avaya Inc. Trusted group of a plurality of devices with single sign on, secure authentication
JP5845573B2 (en) * 2010-12-13 2016-01-20 ソニー株式会社 Learning system and display method
US20120231434A1 (en) 2011-03-11 2012-09-13 Rodney Standage In-Desk Tablet PC and Classroom Automation System
US20140280398A1 (en) * 2013-03-15 2014-09-18 Miosoft Corporation Distributed database management

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102509482A (en) * 2011-11-15 2012-06-20 北京瑞信在线系统技术有限公司 Multimedia teaching system based on mobile terminal framework

Cited By (351)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9646614B2 (en) 2000-03-16 2017-05-09 Apple Inc. Fast, language-independent method for user authentication by voice
US11928604B2 (en) 2005-09-08 2024-03-12 Apple Inc. Method and apparatus for building an intelligent automated assistant
US10318871B2 (en) 2005-09-08 2019-06-11 Apple Inc. Method and apparatus for building an intelligent automated assistant
US11671920B2 (en) 2007-04-03 2023-06-06 Apple Inc. Method and system for operating a multifunction portable electronic device using voice-activation
US11023513B2 (en) 2007-12-20 2021-06-01 Apple Inc. Method and apparatus for searching using an active ontology
US10381016B2 (en) 2008-01-03 2019-08-13 Apple Inc. Methods and apparatus for altering audio output signals
US9865248B2 (en) 2008-04-05 2018-01-09 Apple Inc. Intelligent text-to-speech conversion
US9626955B2 (en) 2008-04-05 2017-04-18 Apple Inc. Intelligent text-to-speech conversion
US10108612B2 (en) 2008-07-31 2018-10-23 Apple Inc. Mobile device having human language translation capability with positional feedback
US11348582B2 (en) 2008-10-02 2022-05-31 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US10643611B2 (en) 2008-10-02 2020-05-05 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US11900936B2 (en) 2008-10-02 2024-02-13 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US11080012B2 (en) 2009-06-05 2021-08-03 Apple Inc. Interface for a virtual digital assistant
US10795541B2 (en) 2009-06-05 2020-10-06 Apple Inc. Intelligent organization of tasks items
US10283110B2 (en) 2009-07-02 2019-05-07 Apple Inc. Methods and apparatuses for automatic speech recognition
US11423886B2 (en) 2010-01-18 2022-08-23 Apple Inc. Task flow identification based on user intent
US10706841B2 (en) 2010-01-18 2020-07-07 Apple Inc. Task flow identification based on user intent
US9548050B2 (en) 2010-01-18 2017-01-17 Apple Inc. Intelligent automated assistant
US10741185B2 (en) 2010-01-18 2020-08-11 Apple Inc. Intelligent automated assistant
US10049675B2 (en) 2010-02-25 2018-08-14 Apple Inc. User profiling for voice input processing
US10692504B2 (en) 2010-02-25 2020-06-23 Apple Inc. User profiling for voice input processing
US9633660B2 (en) 2010-02-25 2017-04-25 Apple Inc. User profiling for voice input processing
US10082892B2 (en) 2011-01-10 2018-09-25 Apple Inc. Button functionality
US9684394B2 (en) 2011-01-10 2017-06-20 Apple Inc. Button functionality
US10102359B2 (en) 2011-03-21 2018-10-16 Apple Inc. Device access using voice authentication
US10417405B2 (en) 2011-03-21 2019-09-17 Apple Inc. Device access using voice authentication
US11350253B2 (en) 2011-06-03 2022-05-31 Apple Inc. Active transport based notifications
US11120372B2 (en) 2011-06-03 2021-09-14 Apple Inc. Performing actions associated with task items that represent tasks to perform
US9798393B2 (en) 2011-08-29 2017-10-24 Apple Inc. Text correction processing
US11200309B2 (en) 2011-09-29 2021-12-14 Apple Inc. Authentication with secondary approver
US10484384B2 (en) 2011-09-29 2019-11-19 Apple Inc. Indirect authentication
US10516997B2 (en) 2011-09-29 2019-12-24 Apple Inc. Authentication with secondary approver
US11755712B2 (en) 2011-09-29 2023-09-12 Apple Inc. Authentication with secondary approver
US10419933B2 (en) 2011-09-29 2019-09-17 Apple Inc. Authentication with secondary approver
US10142835B2 (en) 2011-09-29 2018-11-27 Apple Inc. Authentication with secondary approver
US11069336B2 (en) 2012-03-02 2021-07-20 Apple Inc. Systems and methods for name pronunciation
US10097496B2 (en) 2012-05-09 2018-10-09 Apple Inc. Electronic mail user interface
US10235014B2 (en) 2012-05-09 2019-03-19 Apple Inc. Music user interface
US10649622B2 (en) 2012-05-09 2020-05-12 Apple Inc. Electronic message user interface
US9953088B2 (en) 2012-05-14 2018-04-24 Apple Inc. Crowd sourcing information to fulfill user requests
US11269678B2 (en) 2012-05-15 2022-03-08 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US11321116B2 (en) 2012-05-15 2022-05-03 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US10079014B2 (en) 2012-06-08 2018-09-18 Apple Inc. Name recognition system
US9971774B2 (en) 2012-09-19 2018-05-15 Apple Inc. Voice-based media searching
US11862186B2 (en) 2013-02-07 2024-01-02 Apple Inc. Voice trigger for a digital assistant
US11557310B2 (en) 2013-02-07 2023-01-17 Apple Inc. Voice trigger for a digital assistant
US11636869B2 (en) 2013-02-07 2023-04-25 Apple Inc. Voice trigger for a digital assistant
US10714117B2 (en) 2013-02-07 2020-07-14 Apple Inc. Voice trigger for a digital assistant
US10978090B2 (en) 2013-02-07 2021-04-13 Apple Inc. Voice trigger for a digital assistant
US11388291B2 (en) 2013-03-14 2022-07-12 Apple Inc. System and method for processing voicemail
US11539831B2 (en) 2013-03-15 2022-12-27 Apple Inc. Providing remote interactions with host device using a wireless device
US11798547B2 (en) 2013-03-15 2023-10-24 Apple Inc. Voice activated device for use with a voice-based digital assistant
US9633674B2 (en) 2013-06-07 2017-04-25 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
US9966060B2 (en) 2013-06-07 2018-05-08 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
US9620104B2 (en) 2013-06-07 2017-04-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9966068B2 (en) 2013-06-08 2018-05-08 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10657961B2 (en) 2013-06-08 2020-05-19 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US11048473B2 (en) 2013-06-09 2021-06-29 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US10185542B2 (en) 2013-06-09 2019-01-22 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US11727219B2 (en) 2013-06-09 2023-08-15 Apple Inc. System and method for inferring user intent from speech inputs
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
US10769385B2 (en) 2013-06-09 2020-09-08 Apple Inc. System and method for inferring user intent from speech inputs
US10001817B2 (en) 2013-09-03 2018-06-19 Apple Inc. User interface for manipulating user interface objects with magnetic properties
US11314370B2 (en) 2013-12-06 2022-04-26 Apple Inc. Method for extracting salient dialog usage from live data
US10977651B2 (en) 2014-05-29 2021-04-13 Apple Inc. User interface for payments
US10748153B2 (en) 2014-05-29 2020-08-18 Apple Inc. User interface for payments
US11836725B2 (en) 2014-05-29 2023-12-05 Apple Inc. User interface for payments
US10438205B2 (en) 2014-05-29 2019-10-08 Apple Inc. User interface for payments
US10902424B2 (en) 2014-05-29 2021-01-26 Apple Inc. User interface for payments
US10043185B2 (en) 2014-05-29 2018-08-07 Apple Inc. User interface for payments
US10796309B2 (en) 2014-05-29 2020-10-06 Apple Inc. User interface for payments
US10482461B2 (en) 2014-05-29 2019-11-19 Apple Inc. User interface for payments
US9911123B2 (en) 2014-05-29 2018-03-06 Apple Inc. User interface for payments
US9483763B2 (en) 2014-05-29 2016-11-01 Apple Inc. User interface for payments
US9324067B2 (en) 2014-05-29 2016-04-26 Apple Inc. User interface for payments
US10282727B2 (en) 2014-05-29 2019-05-07 Apple Inc. User interface for payments
US10497365B2 (en) 2014-05-30 2019-12-03 Apple Inc. Multi-command single utterance input method
US10169329B2 (en) 2014-05-30 2019-01-01 Apple Inc. Exemplar-based natural language processing
US10878809B2 (en) 2014-05-30 2020-12-29 Apple Inc. Multi-command single utterance input method
US10083690B2 (en) 2014-05-30 2018-09-25 Apple Inc. Better resolution when referencing to concepts
US10616416B2 (en) 2014-05-30 2020-04-07 Apple Inc. User interface for phone call routing among devices
US11257504B2 (en) 2014-05-30 2022-02-22 Apple Inc. Intelligent assistant for home automation
US11670289B2 (en) 2014-05-30 2023-06-06 Apple Inc. Multi-command single utterance input method
US10657966B2 (en) 2014-05-30 2020-05-19 Apple Inc. Better resolution when referencing to concepts
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US10699717B2 (en) 2014-05-30 2020-06-30 Apple Inc. Intelligent assistant for home automation
US10714095B2 (en) 2014-05-30 2020-07-14 Apple Inc. Intelligent assistant for home automation
US11810562B2 (en) 2014-05-30 2023-11-07 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US11699448B2 (en) 2014-05-30 2023-07-11 Apple Inc. Intelligent assistant for home automation
US11133008B2 (en) 2014-05-30 2021-09-28 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US10313506B2 (en) 2014-05-30 2019-06-04 Apple Inc. Wellness aggregator
US10417344B2 (en) 2014-05-30 2019-09-17 Apple Inc. Exemplar-based natural language processing
US9967401B2 (en) 2014-05-30 2018-05-08 Apple Inc. User interface for phone call routing among devices
US11907013B2 (en) 2014-05-30 2024-02-20 Apple Inc. Continuity of applications across devices
US10178234B2 (en) 2014-05-30 2019-01-08 Apple, Inc. User interface for phone call routing among devices
US10904611B2 (en) 2014-06-30 2021-01-26 Apple Inc. Intelligent automated assistant for TV user interactions
US11838579B2 (en) 2014-06-30 2023-12-05 Apple Inc. Intelligent automated assistant for TV user interactions
US9668024B2 (en) 2014-06-30 2017-05-30 Apple Inc. Intelligent automated assistant for TV user interactions
US11516537B2 (en) 2014-06-30 2022-11-29 Apple Inc. Intelligent automated assistant for TV user interactions
EP3862898A1 (en) * 2014-08-15 2021-08-11 Apple Inc. Authenticated device used to unlock another device
US11126704B2 (en) 2014-08-15 2021-09-21 Apple Inc. Authenticated device used to unlock another device
US10452253B2 (en) 2014-08-15 2019-10-22 Apple Inc. Weather user interface
US10339293B2 (en) 2014-08-15 2019-07-02 Apple Inc. Authenticated device used to unlock another device
WO2016025036A1 (en) * 2014-08-15 2016-02-18 Apple Inc. Authenticated device used to unlock another device
CN106575332A (en) * 2014-08-15 2017-04-19 苹果公司 Authenticated device used to unlock another device
CN106575332B (en) * 2014-08-15 2022-03-29 苹果公司 Authenticated device for unlocking another device
US10114521B2 (en) 2014-09-02 2018-10-30 Apple Inc. Multi-dimensional object rearrangement
US10936164B2 (en) 2014-09-02 2021-03-02 Apple Inc. Reduced size configuration interface
US10320963B2 (en) 2014-09-02 2019-06-11 Apple Inc. Phone user interface
US10914606B2 (en) 2014-09-02 2021-02-09 Apple Inc. User interactions for a mapping application
US10324590B2 (en) 2014-09-02 2019-06-18 Apple Inc. Reduced size configuration interface
US11733055B2 (en) 2014-09-02 2023-08-22 Apple Inc. User interactions for a mapping application
US11941191B2 (en) 2014-09-02 2024-03-26 Apple Inc. Button functionality
US11474626B2 (en) 2014-09-02 2022-10-18 Apple Inc. Button functionality
US9930157B2 (en) 2014-09-02 2018-03-27 Apple Inc. Phone user interface
US11068083B2 (en) 2014-09-02 2021-07-20 Apple Inc. Button functionality
US9575591B2 (en) 2014-09-02 2017-02-21 Apple Inc. Reduced-size interfaces for managing alerts
US10015298B2 (en) 2014-09-02 2018-07-03 Apple Inc. Phone user interface
US11609681B2 (en) 2014-09-02 2023-03-21 Apple Inc. Reduced size configuration interface
US10579225B2 (en) 2014-09-02 2020-03-03 Apple Inc. Reduced size configuration interface
US10281999B2 (en) 2014-09-02 2019-05-07 Apple Inc. Button functionality
US9547419B2 (en) 2014-09-02 2017-01-17 Apple Inc. Reduced size configuration interface
US10066959B2 (en) 2014-09-02 2018-09-04 Apple Inc. User interactions for a mapping application
US11644911B2 (en) 2014-09-02 2023-05-09 Apple Inc. Button functionality
US10254948B2 (en) 2014-09-02 2019-04-09 Apple Inc. Reduced-size user interfaces for dynamically updated application overviews
EP3189434A1 (en) * 2014-09-04 2017-07-12 Microsoft Technology Licensing, LLC Discovery and control of remote media sessions
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10431204B2 (en) 2014-09-11 2019-10-01 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
US9986419B2 (en) 2014-09-30 2018-05-29 Apple Inc. Social reminders
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US10390213B2 (en) 2014-09-30 2019-08-20 Apple Inc. Social reminders
US10453443B2 (en) 2014-09-30 2019-10-22 Apple Inc. Providing an indication of the suitability of speech recognition
US10438595B2 (en) 2014-09-30 2019-10-08 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9574896B2 (en) 2015-02-13 2017-02-21 Apple Inc. Navigation user interface
US10024682B2 (en) 2015-02-13 2018-07-17 Apple Inc. Navigation user interface
US10466883B2 (en) 2015-03-02 2019-11-05 Apple Inc. Screenreader user interface
US11231904B2 (en) 2015-03-06 2022-01-25 Apple Inc. Reducing response latency of intelligent automated assistants
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US10055121B2 (en) 2015-03-07 2018-08-21 Apple Inc. Activity based thresholds and feedbacks
US11842734B2 (en) 2015-03-08 2023-12-12 Apple Inc. Virtual assistant activation
US11079894B2 (en) 2015-03-08 2021-08-03 Apple Inc. Device configuration user interface
US10930282B2 (en) 2015-03-08 2021-02-23 Apple Inc. Competing devices responding to voice triggers
US10311871B2 (en) 2015-03-08 2019-06-04 Apple Inc. Competing devices responding to voice triggers
US10216351B2 (en) 2015-03-08 2019-02-26 Apple Inc. Device configuration user interface
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US10529332B2 (en) 2015-03-08 2020-01-07 Apple Inc. Virtual assistant activation
US11087759B2 (en) 2015-03-08 2021-08-10 Apple Inc. Virtual assistant activation
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US10254911B2 (en) 2015-03-08 2019-04-09 Apple Inc. Device configuration user interface
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US11468282B2 (en) 2015-05-15 2022-10-11 Apple Inc. Virtual assistant in a communication session
US11070949B2 (en) 2015-05-27 2021-07-20 Apple Inc. Systems and methods for proactively identifying and surfacing relevant content on an electronic device with a touch-sensitive display
US11127397B2 (en) 2015-05-27 2021-09-21 Apple Inc. Device voice control
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10681212B2 (en) 2015-06-05 2020-06-09 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US9916075B2 (en) 2015-06-05 2018-03-13 Apple Inc. Formatting content for a reduced-size user interface
US10332079B2 (en) 2015-06-05 2019-06-25 Apple Inc. User interface for loyalty accounts and private label accounts for a wearable device
US10356243B2 (en) 2015-06-05 2019-07-16 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US11783305B2 (en) 2015-06-05 2023-10-10 Apple Inc. User interface for loyalty accounts and private label accounts for a wearable device
US10990934B2 (en) 2015-06-05 2021-04-27 Apple Inc. User interface for loyalty accounts and private label accounts for a wearable device
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US11947873B2 (en) 2015-06-29 2024-04-02 Apple Inc. Virtual assistant for media playback
US11010127B2 (en) 2015-06-29 2021-05-18 Apple Inc. Virtual assistant for media playback
US11809483B2 (en) 2015-09-08 2023-11-07 Apple Inc. Intelligent automated assistant for media search and playback
US11853536B2 (en) 2015-09-08 2023-12-26 Apple Inc. Intelligent automated assistant in a media environment
US11500672B2 (en) 2015-09-08 2022-11-15 Apple Inc. Distributed personal assistant
US11550542B2 (en) 2015-09-08 2023-01-10 Apple Inc. Zero latency digital assistant
US11126400B2 (en) 2015-09-08 2021-09-21 Apple Inc. Zero latency digital assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US11526368B2 (en) 2015-11-06 2022-12-13 Apple Inc. Intelligent automated assistant in a messaging environment
US11809886B2 (en) 2015-11-06 2023-11-07 Apple Inc. Intelligent automated assistant in a messaging environment
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US11886805B2 (en) 2015-11-09 2024-01-30 Apple Inc. Unconventional virtual assistant interactions
US9912909B2 (en) 2015-11-25 2018-03-06 International Business Machines Corporation Combining installed audio-visual sensors with ad-hoc mobile audio-visual sensors for smart meeting rooms
US9584758B1 (en) 2015-11-25 2017-02-28 International Business Machines Corporation Combining installed audio-visual sensors with ad-hoc mobile audio-visual sensors for smart meeting rooms
US11019306B2 (en) 2015-11-25 2021-05-25 International Business Machines Corporation Combining installed audio-visual sensors with ad-hoc mobile audio-visual sensors for smart meeting rooms
US10354652B2 (en) 2015-12-02 2019-07-16 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10942703B2 (en) 2015-12-23 2021-03-09 Apple Inc. Proactive assistance based on dialog communication between devices
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US11206309B2 (en) 2016-05-19 2021-12-21 Apple Inc. User interface for remote authorization
US10749967B2 (en) 2016-05-19 2020-08-18 Apple Inc. User interface for remote authorization
US9847999B2 (en) 2016-05-19 2017-12-19 Apple Inc. User interface for a device requesting remote authorization
US10334054B2 (en) 2016-05-19 2019-06-25 Apple Inc. User interface for a device requesting remote authorization
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US11227589B2 (en) 2016-06-06 2022-01-18 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
US11069347B2 (en) 2016-06-08 2021-07-20 Apple Inc. Intelligent automated assistant for media exploration
US10354011B2 (en) 2016-06-09 2019-07-16 Apple Inc. Intelligent automated assistant in a home environment
US11037565B2 (en) 2016-06-10 2021-06-15 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US11657820B2 (en) 2016-06-10 2023-05-23 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10733993B2 (en) 2016-06-10 2020-08-04 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10297253B2 (en) 2016-06-11 2019-05-21 Apple Inc. Application integration with a digital assistant
US10089072B2 (en) 2016-06-11 2018-10-02 Apple Inc. Intelligent device arbitration and control
US10580409B2 (en) 2016-06-11 2020-03-03 Apple Inc. Application integration with a digital assistant
US10521466B2 (en) 2016-06-11 2019-12-31 Apple Inc. Data driven natural language event detection and classification
US10269345B2 (en) 2016-06-11 2019-04-23 Apple Inc. Intelligent task discovery
US11152002B2 (en) 2016-06-11 2021-10-19 Apple Inc. Application integration with a digital assistant
US11809783B2 (en) 2016-06-11 2023-11-07 Apple Inc. Intelligent device arbitration and control
US11749275B2 (en) 2016-06-11 2023-09-05 Apple Inc. Application integration with a digital assistant
US10942702B2 (en) 2016-06-11 2021-03-09 Apple Inc. Intelligent device arbitration and control
US11037150B2 (en) 2016-06-12 2021-06-15 Apple Inc. User interfaces for transactions
US11900372B2 (en) 2016-06-12 2024-02-13 Apple Inc. User interfaces for transactions
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10553215B2 (en) 2016-09-23 2020-02-04 Apple Inc. Intelligent automated assistant
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US11656884B2 (en) 2017-01-09 2023-05-23 Apple Inc. Application integration with a digital assistant
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US11431836B2 (en) 2017-05-02 2022-08-30 Apple Inc. Methods and interfaces for initiating media playback
US10741181B2 (en) 2017-05-09 2020-08-11 Apple Inc. User interface for correcting recognition errors
US10332518B2 (en) 2017-05-09 2019-06-25 Apple Inc. User interface for correcting recognition errors
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
US11467802B2 (en) 2017-05-11 2022-10-11 Apple Inc. Maintaining privacy of personal information
US11599331B2 (en) 2017-05-11 2023-03-07 Apple Inc. Maintaining privacy of personal information
US10847142B2 (en) 2017-05-11 2020-11-24 Apple Inc. Maintaining privacy of personal information
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
US10755703B2 (en) 2017-05-11 2020-08-25 Apple Inc. Offline personal assistant
US10789945B2 (en) 2017-05-12 2020-09-29 Apple Inc. Low-latency intelligent automated assistant
US10791176B2 (en) 2017-05-12 2020-09-29 Apple Inc. Synchronization and task delegation of a digital assistant
US11862151B2 (en) 2017-05-12 2024-01-02 Apple Inc. Low-latency intelligent automated assistant
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
US10410637B2 (en) 2017-05-12 2019-09-10 Apple Inc. User-specific acoustic models
US11580990B2 (en) 2017-05-12 2023-02-14 Apple Inc. User-specific acoustic models
US11837237B2 (en) 2017-05-12 2023-12-05 Apple Inc. User-specific acoustic models
US11380310B2 (en) 2017-05-12 2022-07-05 Apple Inc. Low-latency intelligent automated assistant
US11405466B2 (en) 2017-05-12 2022-08-02 Apple Inc. Synchronization and task delegation of a digital assistant
US11538469B2 (en) 2017-05-12 2022-12-27 Apple Inc. Low-latency intelligent automated assistant
US10482874B2 (en) 2017-05-15 2019-11-19 Apple Inc. Hierarchical belief states for digital assistants
US10810274B2 (en) 2017-05-15 2020-10-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
US11412081B2 (en) 2017-05-16 2022-08-09 Apple Inc. Methods and interfaces for configuring an electronic device to initiate playback of media
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10992795B2 (en) 2017-05-16 2021-04-27 Apple Inc. Methods and interfaces for home media control
US11675829B2 (en) 2017-05-16 2023-06-13 Apple Inc. Intelligent automated assistant for media exploration
US11201961B2 (en) 2017-05-16 2021-12-14 Apple Inc. Methods and interfaces for adjusting the volume of media
US11532306B2 (en) 2017-05-16 2022-12-20 Apple Inc. Detecting a trigger of a digital assistant
US11683408B2 (en) 2017-05-16 2023-06-20 Apple Inc. Methods and interfaces for home media control
US11095766B2 (en) 2017-05-16 2021-08-17 Apple Inc. Methods and interfaces for adjusting an audible signal based on a spatial position of a voice command source
US11217255B2 (en) 2017-05-16 2022-01-04 Apple Inc. Far-field extension for digital assistant services
US10748546B2 (en) 2017-05-16 2020-08-18 Apple Inc. Digital assistant services based on device capabilities
US10909171B2 (en) 2017-05-16 2021-02-02 Apple Inc. Intelligent automated assistant for media exploration
US11283916B2 (en) 2017-05-16 2022-03-22 Apple Inc. Methods and interfaces for configuring a device in accordance with an audio tone signal
US11750734B2 (en) 2017-05-16 2023-09-05 Apple Inc. Methods for initiating output of at least a component of a signal representative of media currently being played back by another device
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US11636192B2 (en) 2018-01-22 2023-04-25 Apple Inc. Secure login with authentication based on a visual representation of data
US11144624B2 (en) 2018-01-22 2021-10-12 Apple Inc. Secure login with authentication based on a visual representation of data
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US11710482B2 (en) 2018-03-26 2023-07-25 Apple Inc. Natural assistant interaction
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
US11169616B2 (en) 2018-05-07 2021-11-09 Apple Inc. Raise to speak
US11487364B2 (en) 2018-05-07 2022-11-01 Apple Inc. Raise to speak
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US11854539B2 (en) 2018-05-07 2023-12-26 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US11900923B2 (en) 2018-05-07 2024-02-13 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US11907436B2 (en) 2018-05-07 2024-02-20 Apple Inc. Raise to speak
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
US10720160B2 (en) 2018-06-01 2020-07-21 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US11431642B2 (en) 2018-06-01 2022-08-30 Apple Inc. Variable latency device coordination
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
US11495218B2 (en) 2018-06-01 2022-11-08 Apple Inc. Virtual assistant operation in multi-device environments
US11630525B2 (en) 2018-06-01 2023-04-18 Apple Inc. Attention aware virtual assistant dismissal
US10403283B1 (en) 2018-06-01 2019-09-03 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US10984798B2 (en) 2018-06-01 2021-04-20 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US11360577B2 (en) 2018-06-01 2022-06-14 Apple Inc. Attention aware virtual assistant dismissal
US10684703B2 (en) 2018-06-01 2020-06-16 Apple Inc. Attention aware virtual assistant dismissal
US11009970B2 (en) 2018-06-01 2021-05-18 Apple Inc. Attention aware virtual assistant dismissal
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
US10504518B1 (en) 2018-06-03 2019-12-10 Apple Inc. Accelerated task performance
US10496705B1 (en) 2018-06-03 2019-12-03 Apple Inc. Accelerated task performance
US10944859B2 (en) 2018-06-03 2021-03-09 Apple Inc. Accelerated task performance
US11010561B2 (en) 2018-09-27 2021-05-18 Apple Inc. Sentiment prediction from textual data
US11893992B2 (en) 2018-09-28 2024-02-06 Apple Inc. Multi-modal inputs for voice commands
US11170166B2 (en) 2018-09-28 2021-11-09 Apple Inc. Neural typographical error modeling via generative adversarial networks
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US10839159B2 (en) 2018-09-28 2020-11-17 Apple Inc. Named entity normalization in a spoken dialog system
US11475898B2 (en) 2018-10-26 2022-10-18 Apple Inc. Low-latency multi-speaker speech recognition
US11638059B2 (en) 2019-01-04 2023-04-25 Apple Inc. Content playback on multiple devices
CN109743394A (en) * 2019-01-08 2019-05-10 李特 Intelligence desktop device, system and its broadcasting based on remote interaction, test method
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US11783815B2 (en) 2019-03-18 2023-10-10 Apple Inc. Multimodality in digital assistant systems
US11475884B2 (en) 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11423908B2 (en) 2019-05-06 2022-08-23 Apple Inc. Interpreting spoken requests
US11675491B2 (en) 2019-05-06 2023-06-13 Apple Inc. User configurable task triggers
US11217251B2 (en) 2019-05-06 2022-01-04 Apple Inc. Spoken notifications
US11705130B2 (en) 2019-05-06 2023-07-18 Apple Inc. Spoken notifications
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
CN110223543A (en) * 2019-05-16 2019-09-10 泰山医学院 A kind of colleges and universities' wisdom interactive teaching and learning system
US11140099B2 (en) 2019-05-21 2021-10-05 Apple Inc. Providing message response suggestions
US11888791B2 (en) 2019-05-21 2024-01-30 Apple Inc. Providing message response suggestions
US11496600B2 (en) 2019-05-31 2022-11-08 Apple Inc. Remote execution of machine-learned models
US11010121B2 (en) 2019-05-31 2021-05-18 Apple Inc. User interfaces for audio media control
US10996917B2 (en) 2019-05-31 2021-05-04 Apple Inc. User interfaces for audio media control
US11657813B2 (en) 2019-05-31 2023-05-23 Apple Inc. Voice identification in digital assistant systems
US11620103B2 (en) 2019-05-31 2023-04-04 Apple Inc. User interfaces for audio media control
US11289073B2 (en) 2019-05-31 2022-03-29 Apple Inc. Device text to speech
US11360739B2 (en) 2019-05-31 2022-06-14 Apple Inc. User activity shortcut suggestions
US11853646B2 (en) 2019-05-31 2023-12-26 Apple Inc. User interfaces for audio media control
US11237797B2 (en) 2019-05-31 2022-02-01 Apple Inc. User activity shortcut suggestions
US11755273B2 (en) 2019-05-31 2023-09-12 Apple Inc. User interfaces for audio media control
US11790914B2 (en) 2019-06-01 2023-10-17 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
US11360641B2 (en) 2019-06-01 2022-06-14 Apple Inc. Increasing the relevance of new available information
US11488406B2 (en) 2019-09-25 2022-11-01 Apple Inc. Text detection using global geometry estimators
CN111428993A (en) * 2020-03-20 2020-07-17 上海乂学教育科技有限公司 Remote teaching system based on cloud computing
CN111428993B (en) * 2020-03-20 2021-11-16 上海松鼠课堂人工智能科技有限公司 Remote teaching system based on cloud computing
US11765209B2 (en) 2020-05-11 2023-09-19 Apple Inc. Digital assistant hardware abstraction
US11914848B2 (en) 2020-05-11 2024-02-27 Apple Inc. Providing relevant data items based on context
US11924254B2 (en) 2020-05-11 2024-03-05 Apple Inc. Digital assistant hardware abstraction
US11755276B2 (en) 2020-05-12 2023-09-12 Apple Inc. Reducing description length based on confidence
US11838734B2 (en) 2020-07-20 2023-12-05 Apple Inc. Multi-device audio adjustment coordination
US11696060B2 (en) 2020-07-21 2023-07-04 Apple Inc. User identification using headphones
US11750962B2 (en) 2020-07-21 2023-09-05 Apple Inc. User identification using headphones
US11392291B2 (en) 2020-09-25 2022-07-19 Apple Inc. Methods and interfaces for media control with dynamic feedback
US11782598B2 (en) 2020-09-25 2023-10-10 Apple Inc. Methods and interfaces for media control with dynamic feedback
US11847378B2 (en) 2021-06-06 2023-12-19 Apple Inc. User interfaces for audio routing
US11954405B2 (en) 2022-11-07 2024-04-09 Apple Inc. Zero latency digital assistant

Also Published As

Publication number Publication date
US9756049B2 (en) 2017-09-05
CA2892614A1 (en) 2014-05-30
US20150304330A1 (en) 2015-10-22
CA2892614C (en) 2021-06-08

Similar Documents

Publication Publication Date Title
US9756049B2 (en) System and method for managing several mobile devices simultaneously
US9524491B2 (en) Master navigation controller for a web-based conference collaboration tool
US8909704B2 (en) Network-attached display device as an attendee in an online collaborative computing session
US11880630B2 (en) Collaborative remote interactive platform
Li et al. Technology supports for distributed and collaborative learning over the internet
US20130219295A1 (en) Multimedia system and associated methods
US20130007103A1 (en) Managing Interactive Content on Client Devices
JP4412492B2 (en) Remote control system, remote control method and remote control program
CN102509482A (en) Multimedia teaching system based on mobile terminal framework
US11190557B1 (en) Collaborative remote interactive platform
US9953392B2 (en) Multimedia system and associated methods
CN103595759B (en) Desktop presentation method based on high in the clouds
US20140259036A1 (en) Device-Agnostic Content Management, Playback and Status Monitoring System
JP2015191487A (en) presentation server and mobile terminal
US10042530B1 (en) Object oriented interactions
EP3320663B1 (en) Multi-network mirroring systems and methods
US11349889B1 (en) Collaborative remote interactive platform
US20160050255A1 (en) Controlling content on a display device
García et al. Rethinking remote laboratories: Widgets and smart devices
CN105049668A (en) Information processing system, information processing apparatus, method, and storage medium
KR20130076737A (en) Method and apparatus for providing service to a plurality of devices in a environment based on the network
US20230046864A1 (en) Multi-network computing device integration systems and methods
Alwakeel et al. A Novel Interaction Technique for Transferring Files between Smartphones and Public Displays
CN116866344A (en) Intelligent classroom system, intelligent equipment interaction method and computer readable storage medium
GB2495986A (en) Interactive display systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13857498

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
ENP Entry into the national phase

Ref document number: 2892614

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 14646797

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 13857498

Country of ref document: EP

Kind code of ref document: A1