WO2016108212A1

WO2016108212A1 - Portable assessment and proctoring system

Info

Publication number: WO2016108212A1
Application number: PCT/IB2016/050006
Authority: WO
Inventors: Himanshu Aggarwal; Jatin SHARMA
Original assignee: Aggarwal, Varun
Priority date: 2015-01-02
Filing date: 2016-01-02
Publication date: 2016-07-07

Abstract

The present invention relates to portable assessment and proctoring system. In which, a computation device (103) displays a question stored in the computation device (103) along with an identifier or a facial scan. The question is for a candidate (102) being assessed and proctored. Then a response to the question is given by the candidate (102) and is recorded by a camera device (104), which is wore by an assessor (101) of the candidate (102). The computation device (103) receives the response from the camera device (104) and tags the response with the question based on said identifier or said facial scan.

Description

PORTABLE ASSESSMENT AND PROCTORING SYSTEM DESCRIPTION

TECHNICAL FIELD OF INVENTION

The present invention relates to the area of portable assessment and proctoring system.

BACKGROUND OF INVENTION

With the advent of online education, proctoring of a candidate during a mechanism of testing a student's knowledge against cheating is a problematic area. Apart from the above, in case of an interview, proctoring of the candidate can be beneficial for interviewers who might wish to evaluate the candidate, but are not in a position to do so on a personal basis. Thus, there is a need to provide for an assessment and proctoring system, which can be used for recording an examination / assessment process. It is preferred for such assessment / proctoring systems to be portable so that their operation does not create any interference with the overall examination / assessment process. Furthermore, it would be preferred that such assessment / proctoring systems be able to provide co-related information which can assist in various aspects of the examination / assessment process.

SUMMARY OF IN VENTION

Thi s summary is provided to introduce a se led ion of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended as an aid in determining the scope of the claimed subject matter.

Accordingly, the present invention provides a portable assessment and proctoring system comprising a computation device, a camera device which can be carried by an computation device is adapted to be in operational interconnection with the camera device through a wired or wireless medium.

In one embodiment, the invention provides a method implemented at a computation device for assessment and proctoring, the method comprising: displaying, at the computation device , a question stored in the computation device along with an identifier or a facial scan, the question is for a candidate being assessed and proctored; receiving, at the computation device , a response recorded by a camera device which is wore by an assessor of the candidate , the response to the question is given by the candidate ; and tagging, at the computation device , the response with the question based on the identifier or the facial scan.

In another embodiment, the invention provides a computation device for assessment and proctoring, the computation device comprising: a display screen coupled with a control unit and configured to display a question stored in the computation device along with an identifier or a facial scan, the question is for a candidate being assessed and proctored; and an information recorder coupled with the control unit and configured to receive a response recorded by a camera device which is wore by an assessor of the candidate , the response to the question is given by the candidate , and is configured to tag the response with the question based on the identifier or the facial scan.

The details of one or more embodiments are set forth in the accompanying drawings and description below. Other features and advantages will be apparent from a reading of the following detailed description and a review of the associated drawings. It is to be understood that the following detailed description is explanatory only and is not restrictive of the invention as claimed. BRIEF DESCRIPTION OF THE ACCOMPANYING DRAWINGS

To further clarify the advantages and features of the invention, a more particular description of the invention will be rendered by reference to specific embodiments thereof, which is illustrated in the appended drawings. It is appreciated that these drawings depict only typical embodiments of the invention and are therefore not to be considered limiting of its scope. The invention will be described and explained with additional specificity and detail with the accompanying drawings in which:

Figure 1 illustrates a portable assessment and proctoring system, in accordance with an embodiment of the invention; Figure 2 illustrates an exemplary computation device for assessment and proctoring, in accordance with an embodiment of the invention; and

Figure 3 illustrates an exemplary method (300) implemented at a computation device (103) for assessment and proctoring, in accordance with an embodiment of the invention. It may be noted that to the extent possible, like reference numerals have been used to represent like elements in the drawings. Further, those of ordinary skill in the art will appreciate that elements in the drawings are illustrated for simplicity and may not have been necessarily drawn to scale. For example, the dimensions of some of the elements in the drawings may be exaggerated relative to other elements to help to improve understanding of aspects of the invention. Furthermore, the one or more elements may have been represented in the drawings by conventional symbols, and the drawings may show only those specific details that are pertinent to understanding the embodiments of the invention so as not to obscure the drawings with details that will be readily apparent to those of ordinary skill in the art having the benefits of the description herein. DETAILED DESCRIPTION

For the purpose of promoting an understanding of the principles of the invention, reference will now be made to the embodiment illustrated in the drawings and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of the invention is thereby intended, such alterations and further modifications in the illustrated system, and such further applications of the principles of the invention as illustrated therein being contemplated as would normally occur to one skilled in the art to which the invention relates.

It will be understood by those skilled in the art that the foregoing general description and the following detailed description are exemplary and explanatory of the invention and are not intended to be restrictive thereof. Throughout the patent specification, a convention employed is that in the appended drawings, like numerals denote like components.

Reference throughout this specification to "an embodiment", "another embodiment" or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. Thus, the appearances of the phrase "in an embodiment", "in another embodiment" and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.

The terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process or method that comprises a list of steps does not include only those steps but may include other steps not expressly listed or inherent to such process or method. Similarly, one or more devices or sub-systems or elements or structures proceeded by "comprises... a" does not, without more constraints, preclude the existence of other devices or other sub-systems. Various embodiments of the invention will be described below in detail with reference to the accompanying drawings.

Figure 1 illustrates a portable assessment and proctoring system (100), in accordance with an embodiment of the invention. The system (100) can be used by an assessor / invigilator / examiner (101) to record an examination /assessment of a candidate (102). The system (100) involves a computation device (103), such as a tablet, PC, or a mobile. The system (100) also involves a portable wearable camera device (104), such as a portable camera, eyeglasses, cap, earpiece, neck brace, and similar wearable devices, worn by the assessor / invigilator / examiner (101) to capture images / video / audio of the candidate (102) being examined / assessed. The questions appear on the computation device, which are asked by the examiner (101) to the candidate (102). The response of the candidate (102), whether in form of actions, verbal, or written, is recorded by the wearable camera device (104) worn by the examiner (101). The wearable camera device (104) and the computation device (103) can talk to each other using a wired medium (105a), wirelessly (105b) or capturing images from the display screen of the computation device (103). This helps tagging the responses of the candidate as captured by the wearable device to the information available on the computation device (103). Examples of the information include, but are not limited to questions, candidate information, etc. The examiner (101) may rate the response of the candidate (102) on the computation device (103) itself either by selecting options or keying in his feedback. Further, the response can be graded locally or remotely, either manually or automatically by analysing the video of the response through a network (106), for example the Internet. The system (100) therefore acts like both a proctoring system and/or a remote assessment system.

In one implementation, prior to the examination, the information of all the candidates (102) to be assessed is stored in a remote server (107), more specifically in a database (108) accessible at the remote server (107). Alternatively, the database (108) may be implemented locally in the computation device (103) itself. At an assessment centre, an assessor (101) can access the information stored on the remote server (107) using his computation device (103, such as a tablet, smartphone, desktop computer, laptop, or other similar computation devices and an internet connection (106). The computation device (103) then fetches the candidates' information from the remote server (107) and displays the information for each of the candidates (102) one at a time. The information of each of the candidates (102) may be preceded by a unique QR code. The assessor (101) directs his vision and hence the camera device (104) towards the display screen of the computation device (103) and captures the QR code, in the form of an image or video, using the camera device (104). After capturing the QR code, the candidate (102) may be asked to show identification proof, which can also captured be using the same camera device (104). The candidate (102) is then prompted to begin the assessment. Instead of the QR code, the computation device (103) and the camera device (104) may communicate with each other through the wired connection (105a) or the wireless connection (105b), such as Wi-Fi, Bluetooth, etc. Similarly, a new QR code emerges for every question as well so that it can tag the video response with the question being asked. This may also be done through wired connection (105a) or wireless connection (105b).

The assessment may be a physical task where the candidate (102) performs the task using certain tools, it may be a computer based task or a viva voice. The assessor (101) directs the camera device (104) in the direction of the candidate (102) and records the entire assessment. The appearance of another QR code on the computation device (10) marks the end of the question or the assessment for the candidate (102). After that, the assessment video/image/audio may be relayed to the remote server (107). This may be done through online or offline mechanisms. Certain optimization operations may also be performed on the data to trim irrelevant information. The resolution of the captured image / video may be adjusted to high or low depending on the bandwidth of the internet connection used. The video / audio / image is then tagged with the records of the candidate (102) using the QR code captured at the start of the examination. After the data is synchronized on the remote server (107), it can then be accessed by all authorized personnel through a MIS interface. The assessment video / audio / image may also be publically hosted to allow candidates to use the same as job credentials and share with prospective employers to gain job opportunities. The video / audio / images may also be graded locally or at a remote location by one or more experts.

Figure 2 illustrates an exemplary computation device (103) for assessment and proctoring. Examples of the computation device (103) include, but are not limited to a mobile phone, a tablet computer, a laptop, a desktop computer, etc. The computation device (103) may include one or more of: a control unit (200), an Information Retriever (201), an Information Recorder (202), a MIS module (203), a user interface (204), a storage means (205), a communication interface (206), and other components (not shown).

The information retriever(201), the information recorder (202), and/or the MIS module (204) may be implemented as a specified program (whether by means of hardware or software) for controlling or carrying out various functionalities in association with the control unit (200).

The control unit (200) may include one or more processors, microprocessors, microcontrollers, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or the like. The control unit (200) may centrally control the operation of the computation device (103) and its components. The user interface (204) may include mechanisms, such as a touch screen display, for outputting information from the computation device (103) and/or inputting information to the computation device (103). Other examples of input and output mechanisms might include a speaker to receive electrical signals and output audio signals; a camera lens to receive image and/or video signals and output electrical signals; a microphone to receive audio signals and output electrical signals; buttons (e.g., control buttons and/or keys of a keypad) to permit data and control commands to be input into the computation device (103); one or more sensors to recognise user gestures; a vibrator to cause the computation device (103) to vibrate; a display screen to output visual information; a light emitting diode, etc. The storage means (205) may include a random access memory (RAM), a read only memory (ROM), and/or other type of memory to store data and instructions that may be used by the control unit (200). The storage means (205) may also include routines, programs, objects, components, data structures, etc., which perform particular tasks, functions or implement particular abstract data types. The communication interface (206) may include any transceiver-like mechanism that enables the computation device (103) to communicate with other devices and/or systems, for instance a server or a service provider. For example, the communication interface (206) may include a modem or an Ethernet interface to a LAN. The communication interface (206) may also include mechanisms for communicating via a network, such as a wireless network. For example, the communication interface (206) may include a transmitter that may convert baseband signals from the control unit (200) to radio frequency (RF) signals and/or a receiver that may convert RF signals to baseband signals. Alternatively, the communication interface (206) may include a transceiver to perform functions of both a transmitter and a receiver. The communication interface (206) may connect to an optional antenna assembly (not shown) for transmission and/or reception of the RF signals. The communication interface (206) is used broadly here. It may be used to establish a data connection with a chat server. It may also be used for establishing a radio or any other type of connection with partner service providers.

In one embodiment, a computation device (103) comprises: a display screen (204) coupled with a control unit (200) and configured to display question stored in the computation device (103) along with an identifier or a facial scan, the question pertains to a candidate (102) being assessed and proctored; and an information recorder (202) coupled with the control unit (200) and configured to receive response as recorded by a camera device (104) which is wore by an assessor (101) of the candidate (102), the response pertains to a candidate (102), and tag the response with the question based on the identifier or the facial scan.

In a further embodiment, the computation device (103) further comprises: an information retriever (201) coupled with the control unit (200) and configured to retrieve the question along with the identifier or the facial scan from a remote server (107). In a further embodiment, the information recorder (202) is configured to store the tagged response in a database (108) for candidate- specific response analysis.

In a further embodiment, the information recorder (202) is configured to receive a rating for the response from the assessor (101).

In a further embodiment, the information recorder (202) is configured to automatically grade the response at least in part at the computation device (103).

In a further embodiment, the information recorder (202) is configured to send the tagged response to a remote server (107).

In a further embodiment, the information recorder (202) is configured to optimize the tagged response before sending to the remote server (107). Figure 3 illustrates an exemplary method (300) implemented at a computation device (103) for assessment and proctoring. In one embodiment, the method (300) comprises: displaying (301), at the computation device (103), a question stored in the computation device (103) along with an identifier or a facial scan, the question is for a candidate (102) being assessed and proctored; receiving (302), at the computation device (103), a response recorded by a camera device (104) which is wore by an assessor (101) of the candidate (102), the response to the question is given by the candidate (102); and tagging (303), at the computation device (103), the response with the question based on the identifier or the facial scan. In a further embodiment, the method comprises: retrieving (304) the question along with the identifier or the facial scan from a remote server (107).

In a further embodiment, the method comprises: storing (305) the tagged response in a database (108) for candidate- specific response analysis.

In a further embodiment, the method comprises: receiving (306), at the computation device (103), a rating for the response from the assessor (101).

In a further embodiment, the method comprises: automatically grading (307) the response at least in part at the computation device (103).

In a further embodiment, the method comprises: sending (308) the tagged response to a remote server (107). In a further embodiment, the method comprises: optimizing (309) the tagged response before sending to the remote server (107).

Subsequent paragraphs explain the present invention using exemplary use case. Those skilled in the art will appreciate that these use cases are not be construed as a limitation on the scope of present invention. In one use case, the portable camera device (104) and the computation device (103) are unable to communicate using a wired connection (105a) or wireless connection (105b), and the portable camera device (104) can only capture images from the display screen (204) of the computation device (103). In this use case, there can be two methods to mark the start and end of an examination/assessment. First, the information of each candidate (102) is preceded by a unique QR code. The assessor (101) directs his vision towards the display screen (204) of the computation device (103) and captures the QR code, in the form of an image or video, using the portable camera device (104). After capturing the QR code, the candidate (102) may be asked to show an identification proof, which is also captured using the same camera device (104). The candidate (102) is then prompted to begin the assessment. Second, the information of each candidate (102) is tagged with a facial scan of the candidate (102). The assessor (101) directs his vision towards the display screen (204) of the computation device (103) and captures the facial scan in the form of an image or video, using the portable camera device (104). After capturing the facial scan the assessor (101) captures the candidate's face, which is also captured using the same portable camera device (104). The candidate (102) is then prompted to begin the assessment. The two facial scans can be compared to (a) verify the candidate identity and (b) tag the candidate assessment video.

In another use case the portable camera device (104) and the computation device (103) are able to communicate using a wired connection (105a) or a wireless connection (105b). In such a case, a unique identifier can be used to mark the start and end of an examination / assessment. This unique identifier may be shared by the camera device (104) with the computation device (103) using Wi-Fi, blue-tooth, etc. The computation device (103) may be used for the following purposes: (a) the assessment video / audio / image may also be publicly hosted to allow candidates to use the same as job credentials and share with prospective employers to gain job opportunities; (b) a competency based video library may be created by mapping each question to a competency it assesses; (c) subject matter experts may corroborate assessor's ratings on the video/audio/image captured, from a remote location; and (d) vocational trades involve performing repetitive, structured tasks, etc. Existing video based pattern recognition tools can be used to automatically assess/evaluate assessment videos for such trades. This can enable rating candidate assessment video in an automated fashion; automated validation and evaluation of video resumes of candidates, given that these video resumes have been recorded as per the given specifications; and using assessment videos of high rated candidates for training purposes.

Embodiments of the invention have been described in detail for purposes of clarity and understanding. However, it will be appreciated that certain changes and modifications may be practiced within the scope of the appended claims. Thus, although the invention is described with reference to specific embodiments and figures thereof, the embodiments and figures are merely illustrative, and not limiting of the invention. Rather, the scope of the invention is to be determined solely by the appended claims.

Claims

1. A method implemented at a computation device (103) for assessment and proctoring, the method comprising: displaying, at the computation device (103), a question stored in the computation device (103) along with an identifier or a facial scan, the question is for a candidate (102) being assessed and proctored; receiving, at the computation device (103), a response recorded by a camera device (104) which is wore by an assessor (101) of the candidate (102), the response to the question is given by the candidate (102); and tagging, at the computation device (103), the response with the question based on the identifier or the facial scan.

2. The method as claimed in claim 1, further comprising: retrieving the question along with the identifier or the facial scan from a remote server (107).

3. The method as claimed in claim 1, further comprising: storing the tagged response in a database (108) for candidate-specific response analysis.

4. The method as claimed in claim 1, further comprising: receiving, at the computation device (103), a rating for the response from the assessor (101).

5. The method as claimed in claim 1, further comprising: automatically grading the response at least in part at the computation device (103).

6. The method as claimed in claim 1, further comprising: sending the tagged response to a remote server (107).

7. The method as claimed in claim 6, further comprising: optimizing the tagged response before sending to the remote server (107).

8. A computation device (103) for assessment and proctoring, the computation device (103) comprising: a display screen (204) coupled with a control unit (200) and configured to display a question stored in the computation device (103) along with an identifier or a facial scan, the question is for a candidate (102) being assessed and proctored; and an information recorder (202) coupled with the control unit (200) and configured to receive a response recorded by a camera device (104) which is wore by an assessor (101) of the candidate (102), the response to the question is given by the candidate (102), and is configured to tag the response with the question based on the identifier or the facial scan.

9. The computation device (103) as claimed in claim 8, further comprising: an information retriever (201) coupled with the control unit (200) and configured to retrieve the question along with the identifier or the facial scan from a remote server (107).

10. The computation device (103) as claimed in claim 8, wherein the information recorder (202) is further configured to store the tagged response in a database (108) for candidate-specific response analysis.

11. The computation device (103) as claimed in claim 8, wherein the information recorder (202) is further configured to receive a rating for the response from the assessor (101).

12. The computation device (103) as claimed in claim 8, wherein the Information recorder (202) is further configured to automatically grade the response at least in part at the computation device (103).

13. The computation device (103) as claimed in claim 8, wherein the information recorder (202) is further configured to send the tagged response to a remote server (107).

14. The computation device (103) as claimed in claim 13, wherein the information recorder (202) is further configured to optimize the tagged response before sending to the remote server (107).