WO2008083485A1 - Participant response system employing graphical response data analysis tool - Google Patents
Participant response system employing graphical response data analysis tool Download PDFInfo
- Publication number
- WO2008083485A1 WO2008083485A1 PCT/CA2008/000037 CA2008000037W WO2008083485A1 WO 2008083485 A1 WO2008083485 A1 WO 2008083485A1 CA 2008000037 W CA2008000037 W CA 2008000037W WO 2008083485 A1 WO2008083485 A1 WO 2008083485A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- response
- processing structure
- data
- participant
- remote units
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/06—Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C13/00—Voting apparatus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/29—Arrangements for monitoring broadcast services or broadcast-related services
- H04H60/33—Arrangements for monitoring the users' behaviour or opinions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/61—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
- H04H60/64—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 for providing detail information
Definitions
- the present invention relates generally to a participant response system and in particular to a participant response system employing a graphical response data analysis tool.
- Participant response systems for enabling participants of an event to enter responses to posed questions, motions or the like are well known in the art and have wide applicability. For example, during a conference, seminar or the like, participants can be provided with handsets that enable the participants to respond to questions, or to vote on motions raised during the conference or seminar. In the entertainment field, audience members can be provided with handsets that enable the audience members to vote for entertainment programmes or sporting events. These participant response systems are also applicable in the field of education. Students can be provided with handsets that enable the students to answer questions posed during lessons, tests or quizzes. Of significant advantage, these participant response systems provide immediate feedback to presenters, teachers, entertainment programme producers, or event organizers.
- Participant response systems fall generally into two categories, namely wired and wireless participant response systems.
- wired participant response systems the remote units used by participants to respond to posed questions or to vote on motions are typically physically connected to a local area network and communicate with a base or host computer.
- wireless participant response systems the remote units used by participants to respond to posed questions or to vote on motions communicate with the host computer via wireless communication links. Whether wired or wireless, many different types of participant response systems have been considered.
- U.S. Patent No. 2,465,976 to Goldsmith discloses a centercasting network system for polling public opinion by means of radio apparatus installed in numerous outlying voting stations. Groups of outlying voting stations communicate with associated central stations where votes that are obtained by the voting stations are counted or tabulated in accordance with any desired classification of votes. The voting stations gather and store voters' choices in a tangible medium. All of the voting stations within a given group then transmit the stored votes sequentially to the central station that serves the particular group. The total votes are stored at each central station until a master station transmits a start signal to the central station. The central station then transmits the results to the master station sequentially.
- U.S. Patent No. 3,858,212 to Tompkins et al. discloses a multi-purpose information gathering and distribution system comprising a central station having an omni-directional antenna for transmitting information queries to a plurality of remote stations and for gathering data acquired at the remote stations that is returned to the central station by the remote stations in response to the information queries.
- the remote stations are sequentially queried by the central station.
- each remote station transmits the conditions at the remote station together with a remote identification code to the central station.
- a two-way communication system for use with a host computer that includes a control unit, a base station and multiple, hand-held, portable radio/data terminal units.
- the control unit interfaces directly with the host computer but uses a radio link to interface with the portable radio/data terminal units.
- Each portable radio/data terminal unit includes a two-way radio and a data terminal.
- the data terminal includes a keyboard for data entry and an LED display for readout of either received data or locally generated data.
- the host computer initiates communication through polling and/or selection of portable radio/data terminal units via the control unit.
- the control unit in response to a "poll" from the host computer, answers by sending either a previously received message from a portable radio/data terminal unit, or if no message has been received, a "no message" response.
- Polling by the control unit is an invitation to the portable radio/data terminal units to send data to the control unit to be stored, grouped if necessary and sent on to the host computer.
- the control unit polls the portable radio/data terminal units by address in a particular sequence.
- the control unit transmits acknowledgements to the portable radio/data terminal units for received data on the next polling cycle.
- 35,449 to Derks discloses a remote response system comprising a central control unit that transmits a plurality of distinct address words to remotely located response units and a receiver that receives data words transmitted from response units.
- Each response unit includes user operable data entry means and a receiver for receiving address words transmitted from the central control unit.
- Each response unit also includes circuit means for identifying an address word unique to the particular response unit and a transmitter for transmitting data words to the central control unit in response to identification of its unique address word.
- the central control unit comprises means for determining that a valid data word has been received from a response unit and for transmitting an acknowledge message to the response unit that sent the valid word. In response to the received acknowledge message, the particular response unit is conditioned to a second, or "off, mode.
- U.S. Patent No. 5,002,491 to Abrahamson et al. discloses an interactive electronic classroom system for enabling teachers to teach students concepts and to receive immediate feedback regarding how well the students have learned the taught concepts. Structure is provided for enabling students to proceed in lockstep or at their own pace through exercises and quizzes, responding electronically to questions asked, the teacher being able to receive the responses, and to interpret a readout of student responses in histogram or other graphic display form.
- the electronic classroom comprises a central computer and a plurality of student computers, which range from simple devices to full fledged personal computers, connected to the central computer over a network.
- Optional peripheral hardware such as video cassette recorders (VCRs) or other recording/reproducing devices, may be used to provide lessons to students in association with the computer network.
- VCRs video cassette recorders
- U.S. Patent No. 5,724,357 to Derks discloses a wireless remote response system comprising a base unit which retrieves user-entered responses from a plurality of remote response units, each of which is provided to a user.
- the base unit transmits a base data package over a wireless communication link to the plurality of remote response units, which decode the base data packet and load into memory a portion of the decoded base data package at each response unit.
- Each response unit examines the characters loaded into the memory and determines and processes the characters that pertain to that particular response unit.
- U.S. Patent No. 6,302,698 to Ziv-El discloses a networked teaching and learning system comprising a plurality of student computers, a network server and at least one teacher's computer.
- the at least one teacher's computer includes comparison and evaluation logic in communication with the student computers for comparing and evaluating each student keystroke with the characters of an answer, if any, immediately after every student keystroke.
- the teaching and learning system provides character-by-character evaluation for quick learning feedback for students, as well as simultaneous observation at the teacher's computer of multiple student responses identified as correct or incorrect.
- the teaching and learning system enables quick construction of various exercise types, the scoring of unanticipated responses, and the introduction of an explanation component in addition to a direct response to a question.
- Patent No. 6,790,045 to Drimmer discloses a method and system for analyzing student performance by classifying student performance into discrete performance classifications associated with corresponding activities related to an electronic course. An observed student performance level for at least one of the performance classifications is measured. A benchmark performance level or range is established for one or more of the performance classifications. It is then determined whether the observed student performance level is compliant with the established benchmark performance level for the at least one performance classification. Instructive feedback is determined for the observed student based upon any material deviation of the observed student performance from at least one benchmark. [00013]
- U.S. Patent Application Publication No. 2004/0033478 to Knowles et al. discloses a participant response system comprising a plurality of wireless handsets assigned to participants of an event.
- Each handset has a keyboard for allowing a participant to input a response and has audio capability to allow the participant to receive and input audio.
- Each handset is configurable either as a participant response handset to allow a participant to enter a response, or as a base station.
- U.S. Patent Application Publication No. 2004/0072136 to Roschelle et al. discloses a method and system for assessing a student's understanding of a process that may unfold over time and space.
- the system comprises thin client devices in the form of wireless, hand-held, palm-sized computers that communicate with a host workstation.
- the system provides a sophisticated approach of directing students to perform self-explanation, and enables instructors to enhance the value of this pedagogical process by providing meaningful and rapid feedback in a classroom setting.
- U.S. Patent Application Publication No. 2004/0072497 to Buehler et al. discloses a response system and method of retrieving user responses from a plurality of users.
- the response system comprises a plurality of base units and a plurality of response units.
- Each of the response units is adapted to receive a user input selection and to communicate that user's input selection with at least one base unit utilizing wireless communication.
- Personality data is provided for the response units to facilitate communication with a particular base unit.
- the personality data of a particular response unit is changed when it is desired to change the base unit to which that response unit communicates. This allows a response unit to become grouped with a particular base unit at a particular time and to become grouped with another base unit at another particular time.
- U.S. Patent Application Publication No. 2004/0126745 to Bell et al. discloses a method and apparatus for improving math skills. Groups of problems are presented to a student in a sequential manner and points are awarded to the student when the student enters a correct response. Statistics representing the student's performance are recorded and may be viewed in a variety of selectable formats so that parents, teachers and other interested parties can track the student's progress.
- U.S. Patent Application Publication No. 2004/01800317 to Bodner et al. discloses a system and method for analyzing student performance and providing feedback regarding the student performance to an instructor, parent or directly to the student. The system communicates in real time with an educational program to provide contemporaneous feedback or recommendations regarding student performance. In addition the system evaluates the effectiveness of the educational program itself and tracks progress at different levels for example, a student, class, school, or district level. Comprehensive data analysis and statistical computation are performed.
- a participant response system comprising processing structure running an assessment during which participants are prompted to respond to one or more information requests; a plurality of remote units communicating with said processing structure, said remote units being used by participants to input responses to information requests and conveying received response data to said processing structure, said processing structure executing a graphical response data analysis tool that processes received response data thereby to generate response performance data in differing levels; and at least one display device communicating with said processing structure and operable to display graphically said response performance data in one or more of said differing levels.
- the at least one display device is initially conditioned by the processing structure to present response performance data graphically in a low level form.
- the at least one display device initially presents the response performance data as at least one selectable graphical object.
- the at least one display device is conditioned by the processing structure to present the response performance data graphically in a high level form.
- the high level form may be presented in one of a histogram, bar chart, graph and pie chart.
- the graphical response data analysis tool comprises a user interface that is displayed on the at least one display device.
- the user interface comprises a category selection panel in which a list of selectable categories is presented and a main viewing area.
- the main viewing area presents response performance data associated with the category selected from the list.
- One or more of the categories in the list may comprise selectable subcategories.
- the processing structure may be responsive to user selected criteria to limit presented response performance data to that meeting the criteria.
- a participant response system comprising processing structure running an assessment during which participants are prompted to respond to one or more information requests; and a plurality of remote units communicating with said processing structure, said remote units being used by participants to input responses to information requests and conveying received response data to said processing structure, said processing structure executing a graphical response data analysis tool that processes the received response data thereby to generate response performance data, wherein at least one of said remote units processes received response data prior to conveying the response data to said processing structure thereby to distribute the response data processing load.
- a plurality of remote units processes received response data prior to conveying the response data to the processing structure.
- the information requests are questions.
- the processing structure transmits answer data to remote units that process response data.
- the remote units use the answer data to grade input responses and convey the results to the processing structure.
- a participant response system comprising processing structure running an assessment during which participants are prompted to respond to one or more information requests; a plurality of remote units communicating with said processing structure, said remote units being used by participants to input responses to information requests and conveying received response data to said processing structure, said processing structure executing a graphical tool that maintains a list of the remote units communicating with said processing structure, said list identifying each remote unit by type; and at least one display device communicating with said processing structure and operable to display graphically said list.
- the graphical tool monitors the state of the participant response system and updates the list so that remote unit status is identified.
- the processing structure also generates response performance data based on the received response data and correlates the response performance data with remote unit type.
- Figure l is a top plan view of a classroom employing a participant response system
- Figure 2 is a schematic view of the participant response system of
- Figure 1 [00030]
- Figure 3 is a schematic view of an interactive whiteboard forming part of the participant response system of Figures 1 and 2;
- Figures 4a and 4b are side elevational and top plan views of a receiver forming part of the participant response system of Figures 1 and 2;
- Figure 5 is a schematic block diagram of the receiver of Figures 4a and
- Figure 6 is a front plan view of a remote unit forming part of the participant response system of Figures 1 and 2;
- Figure 7 is an enlarged front plan view of the remote unit display
- Figure 8 is a schematic block diagram of the remote unit of Figure 6;
- Figures 9 and 10 show a student roster
- Figure 11 shows a test question displayed on the touch surface of the interactive whiteboard of Figure 3
- Figure 12 shows a graphical user interface (GUI) window of a graphical response data analysis tool displaying test results
- Figure 13 shows an expanded GUI window displaying the test results of Figure 12 in pie chart form
- Figure 14 shows the expanded GUI window of Figure 13 during a right click mouse event
- Figures 15 and 16 show another expanded window displaying the test results of Figure 12 in bar graph form; and [00042] Figure 17 to 33 show information presented on an alternative GUI of the graphical response data analysis tool.
- participant response system 50 is employed in a classroom, lecture hall or theatre of an educational institution such as for example a school, university, college or the like and is used to create tests, quizzes or assessments ("tests"), administer created tests to a class of students and analyze the results of administered tests.
- tests quizzes or assessments
- the participant response system 50 comprises a base or host computer 52, an interactive whiteboard (IWB) 54 physically connected to the host computer 52 via a cable 56, a radio frequency (RF) receiver 58 physically connected to the host computer 52 via a universal serial bus (USB) cable 60, and a plurality of wireless, hand-held remote units 62 communicating with the host computer 52 via the receiver 58.
- the participant response system firmware in this embodiment is implemented on top of IEEE802.15.4 media access control (MAC) protocol layer software provided by Texas Instruments (TI).
- the TI MAC protocol layer software comprises a small real-time kernel and a call Z-stack operating system (OS) to provide simple real-time OS facilities such as for example, timer management, task management and interrupt management. Abstraction layers are used to separate the OS and the hardware drivers for ease of porting to a different OS and hardware platform.
- the IWB 54 is a 60Oi series interactive whiteboard manufactured by SMART Technologies ULC, of Calgary, Alberta, Canada, assignee of the subject application.
- the IWB 54 comprises a large, analog resistive touch screen 70 having a touch surface 72.
- the touch surface 72 is surrounded by a bezel 74.
- a tool tray 76 is affixed to the bezel 74 adjacent the bottom edge of the touch surface 72 and accommodates one or more tools that are used to interact with the touch surface.
- the touch screen 70 is mounted on a wall surface via a mounting bracket 78.
- a boom assembly 80 is also mounted on the wall surface above the touch screen 70 via the mounting bracket 78.
- the boom assembly 80 comprises a speaker housing 82 accommodating a pair of speakers (not shown), a generally horizontal boom 84 extending outwardly from the speaker housing 82 and a projector 86 adjacent the distal end of the boom 84.
- the projector 86 is aimed back towards the touch screen 70 so that the image projected by the projector 86 is presented on the touch surface 72.
- the receiver 58 comprises a casing 100 adapted to be desktop or wall mounted.
- An L-shaped omni-directional antenna 102 is mounted on the front end of the casing 100.
- the rear end of the casing 100 receives the USB cable 60.
- a plurality of light emitting diodes (LEDs) 106 is provided on the top surface of the casing 100. During operation of the receiver 58, the LEDs 106 are illuminated to provide visual feedback concerning the operational status of the receiver 58.
- the LEDs 106 comprise a power status LED and communications status LEDs.
- the receiver 58 may provide visual feedback via a display such as a liquid crystal display (LCD) or via both LEDs and an LCD.
- the receiver electronics are accommodated by the casing 100 and comprise a microprocessor 110 that communicates with non- volatile, random access memory (NVRAM) 112, an LED driver 114 and a USB-UART bridge 116. Power is provided to the receiver 58 via the USB cable connection 60.
- NVRAM non- volatile, random access memory
- the remote unit 62 comprises a casing 120 having a keypad 122, a display 124, a power button 126 and an optional battery status LED (not shown) on its front surface.
- keypad 122 comprises ten (10) dual character (A to J/0 to 9) buttons 130, a plus/minus (+/-) button 132, a fraction/decimal ((x/y)/*) button 134, a true/yes (T/Y) button 136, a false/no (F/N) button 138, a delete (del) button 140, up and down scroll ( ⁇ /v) buttons 142 and 144, a menu button 146, a question/hands up (?) button 148 and an enter button 150.
- Those of still in the art will appreciate that the form of the keypad 122 shown in Figures 6 to 8 is exemplary.
- the keypad 122 may of course comprise an alternative set of keys, a full QWERTY or DVORAK key set or a subset thereof. If desired, the entire physical keypad or a portion thereof may be replaced with a touch screen overlying the LCD display 124 to allow a user to interact with virtual keys.
- the display 124 comprises an upper row of LCD icons 160 disposed above a character display area 162.
- the LCD icons 160 comprise a question number icon 164, a user status icon 166, a network status icon 168, a hands-up (?) icon 170, a battery status icon 172 and a transmission status icon 174.
- the character display area 162 comprises a 128x48 pixel array that is divided into three lines 180.
- Each line 180 can display a total of sixteen (16) characters.
- Remote unit electronics are accommodated by the casing 120 and comprise an LCD controller 200 that communicates with the display 124, an LCD driver 202 that drives the LCD controller 200, a microprocessor 204 that communicates with the LCD driver 202 and the keypad 122, as well as with NVRAM 206 and a printed circuit board, omni- directional antenna 210.
- Power is provided to the remote unit 62 by non-rechargeable and rechargeable batteries (not shown) accommodated by the casing. Alternate power sources such as solar cells or manually cranked generators can also be used to power the remote units.
- remote unit 62 may take a variety of forms.
- the remote units 62 may be cellular phones, personal digital assistants (PDAs), ultra-mobile personal computers, laptop computers, portable media devices with wireless capabilities or other suitable devices that allows users to input responses to questions.
- PDAs personal digital assistants
- the host computer 52 runs participant response application software comprising a session manager that maintains the state of the participant response system 50.
- the session manager maintains a student roster 250 as shown in Figures 9 and 10.
- the student roster 250 identifies the class name, the students in the class by first and last name, the log-in status of the students and whether any of the logged-in students are using a remote device 62 that has a low battery level.
- the manner by which remote unit battery levels are determined is described in co-pending U.S. Patent Application No. (Not Available) to Doerksen et al. entitled “Participant Response System Employing Battery Powered, Wireless Remote Units" filed on even date herewith and assigned to the assignee of the subject application, the content of which is incorporated herein by reference.
- the session manager is responsible for downloading the question answer formats e.g. true/false, yes/no, multiple choice, numerical etc. for the questions of the test being administered, to the remote units 62, for receiving answers to questions input by students using the remote units 62 and for keeping track of the question each student is answering.
- the session manager is also responsible for aggregating answers to questions received from students into results, and grading the answers to questions.
- the host computer 52 also runs SMART NotebookTM whiteboarding software to facilitate interaction with the IWB 54.
- the display output of the host computer 52 is conveyed to the IWB 54 and is used by the projector 86 to present an image on the touch surface 72.
- Pointer interactions with the touch surface 72 are detected by the touch screen 70 and conveyed to the host computer 52.
- the display output of the host computer 52 is in turn adjusted by the host computer to reflect the pointer activity.
- the host computer 52 and IWB 54 thus form a closed- loop.
- the host computer 52 may treat the pointer contacts as writing or erasing or may treat the pointer contacts as mouse events and use the mouse events to control execution of application programs, such as for example the participant response notebook application, executed by the host computer 52.
- the IWB 54 can be used by the instructor to create and administer tests and to analyze test results.
- the participant response application software comprises an administration application that provides a graphical user interface for the session manager to allow the instructor to define and refine test questions, create tests using defined questions, start and stop tests and visualize test results.
- the administration application also allows question definitions to be imported, allows responses, grades and results to be exported and allows tests to be printed together with answer keys.
- the administration application has two modes of operation, namely a Notebook integrated mode and a stand-alone mode.
- the notebook integrated mode the administration application is integrated into the SMART Notebook TM software.
- the stand-alone mode is used when the participant response system 50 includes a different brand of IWB 54 or does not include an IWB. [00054] In this embodiment as shown in Figure 2, the host computer 52, IWB
- the 54 and receiver 58 are physically connected by cables 56 and 60.
- Messages exchanged between the host computer 52, IWB 54 and receiver 58 are structured using extensible markup language (XML) over HTTP.
- the receiver 58 and the remote units 62 communicate over a wireless radio frequency (RF) communications network.
- the microprocessor 110 of the receiver 58 thus provides both a USB interface and an RF interface and runs a service that translates messages in USB protocol to messages in radio frequency (RF) wireless protocol and vice versa as well as IEEE802.15.4 MAC layer software to manage the IEEE802.15.4 network thereby to permit the host computer 52 and remote units 62 to communicate.
- Messages exchanged between the session manager and the receiver 58 comprise a header, a command identification, message bytes and a checksum.
- Consistent overhead byte stuffing is employed to provide frame delimiting of packets thereby to facilitate the determination of the start and end of command packets.
- Messages exchanged between the receiver 58 and the remote units 62 do not include the header and the checksum as the IEEE802.15.4 protocol is used to handle packet addressing and ensure packet integrity.
- the messages exchanged between the session manager, the receiver 58 and the remote units 62 include diagnostic messages, status messages and command messages.
- diagnostic messages comprise, but are not limited to, firmware information query messages, remote unit transmit power query messages and channel identification query messages.
- Status messages comprise, but are not limited to, remote unit status messages, network status messages and personal area network (PAN) ID messages.
- Command messages comprise, but are not limited to, log-in messages, log-out messages, log-in grant messages, question download messages, optional answer download messages, answer upload messages, hands-up messages, test start messages and test end messages.
- wireless communications between the host computer 52 and the remote units 62 are carried out according to the IEEE802.15.4 specification, as described in co-pending U.S. Patent Application No. (Not Available) to Lam entitled "Participant Response System With Reduced Communications Bandwidth" filed on even date herewith and assigned to the assignee of the subject application, the content of which is incorporated herein by reference.
- the session manager When a test is being administered to students, the session manager generates one or more question download messages that include the question answer formats for the questions of the test.
- the question download messages are then sent to the receiver 58, which in turn embeds the question download messages in the next beacon frame and broadcasts the beacon frame embodying the question download messages to all of the remote units 62 simultaneously.
- each active remote unit 62 Upon receipt of the beacon frame, each active remote unit 62 in turn loads the question download messages into memory 206.
- the student associated with each remote unit 62 can then use the scroll buttons 142 and 144 to select the question to which the student wishes to respond so that the question answer format for the selected question is displayed.
- the host computer 52 also provides display data to the IWB 54 resulting in the projector 78 projecting the questions of the test on the touch surface 72 of the touch screen 70.
- each question is displayed on the touch surface 70 independently as shown in Figure 11 thereby to facilitate viewing by the students.
- the question is a true/false type question
- the question answer format corresponding to the question that is displayed by the remote units 62 provides true and false selections.
- the question can be answered using either the true/yes button 136 or the false/no button 138.
- the question answer format corresponding to the question that is displayed by the remote units 62 provides yes and no selections.
- the question can be answered using either the true/yes button 136 or the false/no button 138.
- the question answer format corresponding to the question that is displayed by the remote units 62 provides choice selections or a line for the numeric answer.
- the question can be answered using the dual character buttons 130, the +/- button 132 and/or fraction/decimal button 134.
- the remote unit 62 generates an answer upload message that includes the question number and the student's answer and sends the answer upload message to the receiver 58, which in turn passes the answer upload message to the host computer 52.
- the session manager saves the answer upload message and analyzes the answer thereby to provide the results to the administration application.
- the session manager aggregates the responses received from the students for each question and compiles the results.
- the results can be made available in a variety of formats depending on the needs of the administration application.
- the results may comprise a complete list of all responses for each question, identical answers provided by different students can be grouped so that answer percentages can be readily determined or the results may simply comprise the overall scores.
- the administration application in this embodiment provides a graphical response analysis tool that enables the instructor to see various levels of detail concerning responses to questions without exporting the results to other programs together with the corresponding questions.
- GUI graphical user interface
- the graphical response data analysis tool is selected, a small graphical user interface (GUI) window is displayed over top of the corresponding question page using graphical controls, such as for example, Adobe Flash, as shown in Figure 12.
- the window identifies the correct answer, low level aggregate response performance data such as the percentage of students who correctly answered the question, an expand button and a clear button. If the expand button is selected, higher level response performance data such as a graphical representation of the results is displayed as shown in Figure 13.
- the graphical representation is a pie chart that shows the percentage of students who submitted identical answers as well as the percentage of students that did not submit a response to the question.
- the graphical representation also includes a legend, a histogram button, a clear button and a reduce button. If a right click mouse event is made over a section of the pie chart, the names of the students associated with that pie chart section are displayed as shown in Figure 14. When the right click mouse event is terminated, the students names disappear. If the histogram button is selected, a bar graph showing the same results is displayed as shown in Figures 15 and 16.
- the bar graph similarly includes a clear button, a reduce button and a pie chart button and offers the same right click mouse event capability described above.
- the graphical tool lumps identical numeric results into a histogram. Incorrect numeric results that are not repeated by numerous students i.e. the incorrect numeric results are unique, are placed in an "other" category. Incorrect numeric results that are repeated, whether identical or similar, can be accumulated and used to populate a histogram bin associated with the incorrect answer. This allows the instructor to identify situations where a number of students make a common or similar mistake allowing the teacher to explain the misconception(s).
- the graphical tool can be configured to display high level answer detail initially rather than low level aggregate answer detail as described above. In this case, the graphical controls allow the level of answer detail to be reduced.
- the processing capabilities of the remote units 62 can be utilized to grade input answers.
- answer download messages are conveyed to the remote units 62.
- the remote unit 62 compares the input answer with the corresponding answer download message and generates an answer upload message comprising one of two values signifying either a correct or incorrect response.
- the remote unit can use the answer download messages to display the results to the user without transmitting answer upload messages to the host computer.
- the graphical response data analysis tool provides the facility to visually display response performance data by class and to generate performance reports.
- the graphical response data analysis tool provides a graphical user interface comprising a selection pane 300 that displays available classes and available performance reports in a list as selectable items together with a main viewing area 302 that displays information relating to the class or performance report that has been selected.
- Figure 17 shows a home screen displayed in the main viewing area for a selected class. As can be seen, the main viewing area in this case is divided into four primary quadrants.
- the top left quadrant identifies the ratio of students in the class which are currently logged-in with registered remote units 62.
- the top right quadrant shows class information and includes a selectable update button 304 to enable the class information to be updated.
- the bottom left quadrant shows a graph of the overall class performance as a percentage over time.
- the bottom right quadrant displays a graph showing the class grade distribution.
- Figure 18 shows a gradebook 310 displayed in the main viewing area
- the gradebook identifies the individual students in the class and for each student, shows the student's cumulative average and the student's mark on each test or assessment. Selecting an individual student identified in the gradebook 310 results in a performance graph 312 for the student being displayed in the bottom half of the main viewing area 302 as shown in Figure 19.
- the performance graph 312 plots both the student's performance and the class average.
- user selected, personalized reporting criteria can be entered in a tag 314 so that the student performance information displayed in the main viewing area 302 is limited to information that meets the entered criteria as shown in Figure 20.
- Figure 21 shows the information presented in the main viewing area
- assessments given to a selected class are identified by title, category and data issued.
- the class average and the average raw score for each assessment are also provided. Selecting an individual assessment results in the display of further details concerning the class performance on the assessment as shown in Figure 22.
- Figure 23 shows a student performance report displayed in the main viewing area 302 for a selected student.
- the main viewing area displays information concerning the student, school, teacher and year, together with graphical information concerning the student's performance.
- the graphical information includes the student's performance vs. class in bar chart form, the student's mean performance vs. topic in bar chart form and the student's mean performance vs. attainment target in bar chart form.
- Each of these bar charts can be selected and expanded to the entire main viewing area 302 as shown in Figures 24 and 25.
- Detailed student performance information can also be displayed in the main viewing area 302 as shown in Figure 26.
- Figure 27 shows class performance information displayed in the main viewing area 302 for a selected class.
- the displayed information includes a bar chart showing overall class performance, a bar chart showing mean student performance vs. gender and a bar chart showing mean student performance vs. social class.
- Each of these graphical charts can be selected and expanded to the entire main viewing area 302 as shown in Figure 28.
- user selected reporting criteria can be input into tags and used to create customized reports as shown in Figure 29.
- Figure 30 shows performance information displayed in the main viewing area 302 for a subgroup of a selected class.
- the subgroup performance information is similar to that displayed for the class except limited to a subset of the class.
- Figure 31 shows curriculum performance information displayed in the main viewing area 302.
- a student performance vs. key stages bar chart a mean student performance vs. topic bar chart and a mean student performance vs. attainment target bar chart are presented.
- Detailed information concerning student performance in various areas of the curriculum can also be displayed as shown in Figure 32.
- Figure 33 shows the information displayed in the main viewing area 302 for devices of a selected class.
- each type of device used by students is identified together with their connection status and name together.
- a diagnostic panel displays the state of the system is also presented.
- remote units 62 used by students include a plurality of the illustrated types as identified by the term "clicker" as well as a number of remote computers. Keeping track of the device types used by students, allows student performance to be correlated to device type allowing devices that provide are associated with better or poorer results to be identified.
- the receiver 58 and remote units 62 can communicate according to the ZigBee specification.
- the receiver 58 and the host computer 52 can communicate over other wired communication links such as RS-232 or Ethernet connections or over a wireless communication link.
- the receiver 58 may be integrated into the host computer 52 such that the host computer 52 and remote units 62 communicate directly over a wireless communication link via a compatible wireless protocol such as for example Zigbee, Z- Wave, ANT IEEE802.1 lb/g/n or BluetoothTM.
- the IWB 54 is described as including an analog resistive touch screen 70, those of skill in the art will appreciate that other types of touch screens, such as for example camera-based, surface acoustic wave, capacitive, electromagnetic etc. touch screens may be used.
- touch screens such as for example camera-based, surface acoustic wave, capacitive, electromagnetic etc. touch screens may be used.
- the questions can be projected onto a non-interactive display surface or delivered to students on handouts. In either case, the instructor interacts with the administration application via the monitor of the host computer 52.
- participant response system 50 provides for various advantages that achieve greater operability and user- friendliness. For example, one of the advantages is that all questions and answers are preferably broadcast from the teacher to the students. Logged-in students will thus receive the test and answers. Each student can then work at his/her own pace, and that pace is preferably not controlled by the teacher.
- the teacher can not set software- controlled time limits for responses from either the whole class or from an individual student, so each student can advance at a comfortable pace. Furthermore, since the students preferably can not provide narrative responses, tests will be more efficiently conducted. Another advantage is that the participant response system 50 preferably does not allow the student to operate more than one interactive program at a time. This keeps the student's attention focused on the test at hand. Further, the remote units 62 preferably do not decode a teacher data packet that includes a plurality of characters, a portion of which pertain to different remote units. Also, since the IEEE802.15.4 specification is used, which implements a direct sequence spread spectrum modulation scheme, the communication link from the teacher is not subject to variation in timing between the rising and falling edges of the signal.
- the remote units 62 are less susceptible to interference and RF noise accurate information can be transmitted.
- the host computer 52 persistently stores partial test results until the entire test is complete. Preferably, an open session between students and teacher is maintained until the test is complete. In no case is information from one test section included in information regarding another test section transmitted to the teacher. This gives each student greater flexibility in responding to the test, and increases the robustness of the communication protocol, hi the participant response system 50, preferably, the remote units 62 do not immediately transmit each student keystroke of a multi-character response without waiting for the next keystroke. The entire response is sent when completed.
- the participant response system 50 can not be used in a multi -teacher environment, to avoid confusion in which the teacher has control over the test.
- the teacher does not place answers in an answer buffer, does not strip answers from a message, and does not leave a designated blank space in place of each answer or selected character.
- the remote units 62 do not store an application-specific text file, and they are not programmed to be used for a plurality of different applications solely by modifying such input text file. Likewise, the remote units 62 do not have any structure or function for identifying a particular one address word (assigned to that particular remote unit) from a list of address words sequentially broadcast by the teacher; nor does the host computer 52 have any structure or function for performing such a broadcast.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Health & Medical Sciences (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Electrically Operated Instructional Devices (AREA)
- Debugging And Monitoring (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200880002084A CN101849253A (en) | 2007-01-10 | 2008-01-10 | Participant response system employing graphical response data analysis tool |
EP08700504A EP2118875A4 (en) | 2007-01-10 | 2008-01-10 | Participant response system employing graphical response data analysis tool |
US12/522,844 US20100185957A1 (en) | 2007-01-10 | 2008-01-10 | Participant response system employing graphical response data analysis tool |
MX2009007432A MX2009007432A (en) | 2007-01-10 | 2008-01-10 | Participant response system employing graphical response data analysis tool. |
AU2008204688A AU2008204688B2 (en) | 2007-01-10 | 2008-01-10 | Participant response system employing graphical response data analysis tool |
CA002673850A CA2673850A1 (en) | 2007-01-10 | 2008-01-10 | Participant response system employing graphical response data analysis tool |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US87957207P | 2007-01-10 | 2007-01-10 | |
US60/879,572 | 2007-01-10 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2008083485A1 true WO2008083485A1 (en) | 2008-07-17 |
Family
ID=39608290
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CA2008/000037 WO2008083485A1 (en) | 2007-01-10 | 2008-01-10 | Participant response system employing graphical response data analysis tool |
Country Status (9)
Country | Link |
---|---|
US (1) | US20100185957A1 (en) |
EP (1) | EP2118875A4 (en) |
KR (1) | KR20090116735A (en) |
CN (1) | CN101849253A (en) |
AU (1) | AU2008204688B2 (en) |
CA (1) | CA2673850A1 (en) |
MX (1) | MX2009007432A (en) |
RU (1) | RU2009125360A (en) |
WO (1) | WO2008083485A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2586021A2 (en) * | 2010-06-25 | 2013-05-01 | SMART Technologies ULC | Equation-based assessment grading method and participant response system employing same |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4780210B2 (en) * | 2009-03-17 | 2011-09-28 | コニカミノルタビジネステクノロジーズ株式会社 | Image display device, image display method, and image display program |
US8521823B1 (en) * | 2009-09-04 | 2013-08-27 | Google Inc. | System and method for targeting information based on message content in a reply |
US8616896B2 (en) * | 2010-05-27 | 2013-12-31 | Qstream, Inc. | Method and system for collection, aggregation and distribution of free-text information |
EP2538375A1 (en) * | 2011-06-23 | 2012-12-26 | NV Mobicage | A communication platform for iterative multiparty convergence towards a microdecision |
US9355373B2 (en) | 2012-02-24 | 2016-05-31 | National Assoc. Of Boards Of Pharmacy | Outlier detection tool |
WO2013126701A1 (en) * | 2012-02-24 | 2013-08-29 | National Assoc. Of Boards Of Pharmacy | Test pallet assembly and family assignment |
US9389981B2 (en) * | 2012-09-12 | 2016-07-12 | Microsoft Technology Licensing, Llc | Hierarchical live graphs for performance data display |
US20140136626A1 (en) * | 2012-11-15 | 2014-05-15 | Microsoft Corporation | Interactive Presentations |
US9319848B2 (en) | 2014-05-02 | 2016-04-19 | Macmillan New Ventures, LLC | Audience response communication system with long beacon |
USD768651S1 (en) * | 2014-12-30 | 2016-10-11 | General Electric Company | Display screen or portion thereof with graphical user interface |
WO2017099805A1 (en) * | 2015-12-11 | 2017-06-15 | Hewlett-Packard Development Company, L.P. | Graphical response grouping |
CN109062480A (en) * | 2018-07-12 | 2018-12-21 | 北京猫眼文化传媒有限公司 | A kind of information display method and device |
CN111223226A (en) * | 2020-01-07 | 2020-06-02 | 华南农业大学 | Anonymous scene voting system and voting method thereof |
CN114882751B (en) * | 2022-06-02 | 2024-04-16 | 北京新唐思创教育科技有限公司 | Voting method and device for selection questions and electronic equipment |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5226177A (en) * | 1990-03-27 | 1993-07-06 | Viewfacts, Inc. | Real-time wireless audience response system |
US5827070A (en) * | 1992-10-09 | 1998-10-27 | Educational Testing Service | System and methods for computer based testing |
US20040180317A1 (en) * | 2002-09-30 | 2004-09-16 | Mark Bodner | System and method for analysis and feedback of student performance |
US20040219504A1 (en) * | 2003-05-02 | 2004-11-04 | Auckland Uniservices Limited | System, method and computer program for student assessment |
US20050026131A1 (en) * | 2003-07-31 | 2005-02-03 | Elzinga C. Bret | Systems and methods for providing a dynamic continual improvement educational environment |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8092227B2 (en) * | 2001-02-21 | 2012-01-10 | Sri International | Method and apparatus for group learning via sequential explanation templates |
US7261239B2 (en) * | 2003-12-17 | 2007-08-28 | Bindu Rama Rao | Questionnaire network for mobile handsets and a trading system for contracts on user commitments to answer questionnaires |
US7680250B1 (en) * | 2004-11-24 | 2010-03-16 | Interactive Quality Services | Interactive method and system of testing an automated call telephonic communication system |
US20070172810A1 (en) * | 2006-01-26 | 2007-07-26 | Let's Go Learn, Inc. | Systems and methods for generating reading diagnostic assessments |
US20070178432A1 (en) * | 2006-02-02 | 2007-08-02 | Les Davis | Test management and assessment system and method |
-
2008
- 2008-01-10 EP EP08700504A patent/EP2118875A4/en not_active Withdrawn
- 2008-01-10 CA CA002673850A patent/CA2673850A1/en not_active Abandoned
- 2008-01-10 MX MX2009007432A patent/MX2009007432A/en not_active Application Discontinuation
- 2008-01-10 US US12/522,844 patent/US20100185957A1/en not_active Abandoned
- 2008-01-10 AU AU2008204688A patent/AU2008204688B2/en not_active Ceased
- 2008-01-10 WO PCT/CA2008/000037 patent/WO2008083485A1/en active Application Filing
- 2008-01-10 KR KR1020097016421A patent/KR20090116735A/en not_active Application Discontinuation
- 2008-01-10 RU RU2009125360/12A patent/RU2009125360A/en unknown
- 2008-01-10 CN CN200880002084A patent/CN101849253A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5226177A (en) * | 1990-03-27 | 1993-07-06 | Viewfacts, Inc. | Real-time wireless audience response system |
US5827070A (en) * | 1992-10-09 | 1998-10-27 | Educational Testing Service | System and methods for computer based testing |
US20040180317A1 (en) * | 2002-09-30 | 2004-09-16 | Mark Bodner | System and method for analysis and feedback of student performance |
US20040219504A1 (en) * | 2003-05-02 | 2004-11-04 | Auckland Uniservices Limited | System, method and computer program for student assessment |
US20050026131A1 (en) * | 2003-07-31 | 2005-02-03 | Elzinga C. Bret | Systems and methods for providing a dynamic continual improvement educational environment |
Non-Patent Citations (1)
Title |
---|
See also references of EP2118875A4 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2586021A2 (en) * | 2010-06-25 | 2013-05-01 | SMART Technologies ULC | Equation-based assessment grading method and participant response system employing same |
EP2586021A4 (en) * | 2010-06-25 | 2015-04-15 | Smart Technologies Ulc | Equation-based assessment grading method and participant response system employing same |
US9117375B2 (en) | 2010-06-25 | 2015-08-25 | Smart Technologies Ulc | Equation-based assessment grading method and participant response system employing same |
Also Published As
Publication number | Publication date |
---|---|
CN101849253A (en) | 2010-09-29 |
EP2118875A1 (en) | 2009-11-18 |
RU2009125360A (en) | 2011-02-20 |
CA2673850A1 (en) | 2008-07-17 |
AU2008204688B2 (en) | 2012-12-06 |
KR20090116735A (en) | 2009-11-11 |
AU2008204688A1 (en) | 2008-07-17 |
MX2009007432A (en) | 2009-08-18 |
US20100185957A1 (en) | 2010-07-22 |
EP2118875A4 (en) | 2011-08-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
AU2008204688B2 (en) | Participant response system employing graphical response data analysis tool | |
US8639961B2 (en) | Participant response system employing battery powered, wireless remote units | |
US20100178645A1 (en) | Participant response system with question authoring/editing facility | |
US20100315994A1 (en) | Participant response system with facilitated communications bandwidth | |
US20110244953A1 (en) | Participant response system for the team selection and method therefor | |
US20020031755A1 (en) | System and method for testing students | |
US20120242688A1 (en) | Data presentation method and participant response system employing same | |
GB2443309A (en) | An audience response system | |
TWI723826B (en) | On-line examination system and operating method thereof | |
AU2012254929A1 (en) | Participant response system with facilitated communications bandwith | |
KR200373212Y1 (en) | Remote controller and Education service device and method using that | |
Cherepok et al. | Modern interactive platforms as a tool for distance learning in higher education | |
Hajiyev et al. | Interactive auditorium response and student progress evaluation system | |
KR20030090190A (en) | System and Method for Providing a Service of remote Examination by using Internet and Examination Portable Device | |
KR20220147047A (en) | Multi-channel online education sever and system | |
KR200229433Y1 (en) | Realtime control system for multimedia network | |
KR20060036967A (en) | Remote controller and education service device and method using that | |
KR20110131517A (en) | Mobile education system | |
DESTREZA et al. | One Click: The CECS Students’ Assistant Tools |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200880002084.5 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 08700504 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2673850 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2008700504 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2008204688 Country of ref document: AU |
|
WWE | Wipo information: entry into national phase |
Ref document number: MX/A/2009/007432 Country of ref document: MX |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2008204688 Country of ref document: AU Date of ref document: 20080110 Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 578733 Country of ref document: NZ |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020097016421 Country of ref document: KR |
|
ENP | Entry into the national phase |
Ref document number: 2009125360 Country of ref document: RU Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12522844 Country of ref document: US |