KR20210138477A - Electronic device for providing online examination and method thereof - Google Patents

Abstract

Various embodiments of the present invention relate to an electronic device which comprises: a memory communication module including a database for storing applicant information; and a processor operatively linked to the communication module and the memory, wherein the processor may be configured to receive examinee information from a plurality of first external electronic devices, compare the examinee information with the applicant information stored in the memory to determine whether they are matched or not, and transmit the applicant information, the examinee information, and information on a result of comparison and matching determination to at least one second external electronic device. Moreover, the processor may be configured to transmit information on examination questions to the first external electronic devices, receive information on a real-time image of the examinee from a plurality of third external electronic devices to store the information on the real-time image of the examinee, and transmit the information on the real-time image of the examinee to at least one electronic device for supervising an examination when the applicant information and the examinee information are matched as a result of comparison and matching determination. Accordingly, a method for allowing examinees to take the examination is provided online to manage an examination environment for the examinees and supervise the examination, thereby effectively preventing cheating of the examinees.

Description

ELECTRONIC DEVICE FOR PROVIDING ONLINE EXAMINATION AND METHOD THEREOF

This document relates to an electronic device, including, for example, an electronic device for providing and supervising a test to each external device online.

Various recent electronic devices may transmit data to or receive data from an external electronic device spaced apart using wireless communication, and may allow the external electronic device to visually and aurally output the transmitted data. have. Therefore, data input/output and transmission/reception are possible even over long distances.

An artificial intelligence system is a system that enables electronic devices to learn and make decisions on their own. Artificial intelligence technology consists of machine learning (eg, deep learning) that classifies and learns the characteristics of input data by itself and element technologies using machine learning. Recently, artificial intelligence technology has been used in various fields. For example, visual understanding is a technology for recognizing and processing objects like human vision, and includes object recognition, object tracking, image search, human recognition, scene understanding, spatial understanding, and the like.

Recently, as various services and events began to be conducted in a non-face-to-face manner, a non-face-to-face test is required. Due to the nature of the test, management of test takers must be done in real time, and supervision of cheating and prohibited items must also be done in real time, non-face-to-face. In particular, as the number of test takers increases, management and supervision need to be performed automatically. In the case of an online test, as in the case of an offline test, it is assumed that all test takers are not in the same space. Therefore, the management and supervision of all test takers may be limited by human handling. Therefore, automated test management and supervision of large numbers of test takers online may be required.

In the electronic device according to various embodiments disclosed in this document, the electronic device includes a memory communication module including a database for storing applicant information, and a processor operatively connected to the communication module and the memory, wherein the processor includes: 1 Receive candidate information from an external electronic device and compare whether the candidate information and the applicant information stored in the memory match, and compare the applicant information, the candidate information, and the match with at least one second external electronic device one comparison result information is transmitted, and when the applicant information and the candidate information match as a result of comparing the match, the test question information is transmitted to the plurality of first external electronic devices, and from a plurality of third external electronic devices It may be configured to receive real-time test taker image information, store the real-time test taker image information in the memory, and transmit the real-time test taker image information to at least one electronic device for exam supervision.

In the method of providing an online test by an electronic device according to various embodiments disclosed herein, the test taker information is received from a plurality of first external electronic devices and the test taker information is compared with the applicant information stored in the memory. transmitting the applicant information, the test taker information, and the comparison result information comparing the match to at least one second external electronic device; transmitting test question information to the plurality of first external electronic devices, receiving real-time test taker image information from a plurality of third external electronic devices, storing the real-time test taker image information in a memory, and storing the real-time test taker image information at least It may include transmitting to one electronic device for test supervision.

According to various embodiments of the present disclosure, a method for conducting an online test may be provided to manage the test taker's test environment and supervise the test in real time. For example, the test server may compare applicant and test taker information, integrate and manage the test taker status, and transmit a real-time test taker image to the administrator's external electronic device. As another example, it is possible to check whether the test taker violates a predetermined rule by directly analyzing the test taker's image on the server, and it is possible to effectively prevent cheating.

1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure;
2 is an example illustrating a communication method and an operation method between a server and an external electronic device according to various embodiments of the present disclosure;
3 is a block diagram of a server according to various embodiments.
4 is an operation flowchart of a server that provides an online test according to various embodiments of the present disclosure;
5 is an example of displaying gaze status information according to various embodiments.
6 is a flowchart illustrating an operation of a server when an exam status is abnormal in an online exam according to various embodiments of the present disclosure;
7 is an example illustrating an online test supervision method according to various embodiments of the present disclosure;
8 is a flowchart of an operation of a server related to supervision using a real-time candidate image according to various embodiments of the present disclosure;
9A, 9B, and 9C are examples of real-time candidate image information according to various embodiments of the present disclosure;
10 is an operation flowchart of a server related to remote control in an online test according to various embodiments of the present disclosure;

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 . In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, the program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 uses less power than the main processor 121 or is set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 may be, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The AI model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 or an external electronic device (eg, a sound output module 155 ) directly or wirelessly connected to the electronic device 101 . The electronic device 102) (eg, a speaker or headphones) may output a sound.

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more specified protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. The server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

2 is an example illustrating a communication method and an operation method between a server and an external electronic device according to various embodiments of the present disclosure;

Referring to FIG. 2 , the server 200 may include a gaze server 201 and a supervisor server 202 . According to various embodiments, the gaze server 201 and the supervision server 202 may be integrated to operate as one server 200 . According to various embodiments, the server 200 performs wired/wireless communication with the first external electronic device 203 , the second external electronic device 204 , and the third external electronic device 300 (eg, first in FIG. 1 ). network 198 or a second network 199). For example, the test server 201 may be connected to the first external electronic device 203 and the test management electronic device 205 , respectively, and the supervision server 202 may be connected to the second external electronic device 204 and the test, respectively. Although it may be connected to the supervisory electronic device 206 , it is not limited to the above-described example, and each of the servers 201 and 202 may perform a connection with each of the external electronic devices 203 , 204 , and 300 .

The first external electronic device 203 may be the candidate's electronic device. For example, the first external electronic device 203 may be an electronic device used by a test taker to take an exam. According to various embodiments, the first external electronic device includes a communication module (eg, the communication module 190 of FIG. 1 ), a processor (eg, the processor 120 of FIG. 1 ), and a display (eg, the display module ( ) of FIG. 1 ). 160)) and an input module (eg, the input module 150 of FIG. 1 ). According to various embodiments, the test taker may receive test take-related information including test question information from the test test server 201 through the first external electronic device 203 , and the test taker may receive the test taker information through the first external electronic device 203 . ) may be used to transmit information necessary for taking the test (eg, information about test takers) to the test server 201 . The first external electronic device 203 may receive information (eg, test question information) necessary for the test taker to perform the test from the test server 201 . According to various embodiments, the first external electronic device may transmit answer information for the exam question to the exam server.

The second external electronic device 204 may be the candidate's electronic device. For example, the second external electronic device 204 may be a device necessary to remotely supervise a candidate, and the second external electronic device 204 may be a device for capturing a gaze image of a candidate in real time. According to various embodiments, the second external electronic device includes a communication module (eg, the communication module 190 of FIG. 1 ), a processor (eg, the processor 120 of FIG. 1 ), and a display (eg, the display module ( ) of FIG. 1 ). 160)) and an input module (eg, the input module 150 of FIG. 1 ), and may include a camera (eg, the camera module 180 of FIG. 1 ). According to various embodiments of the present disclosure, the second external electronic device may transmit, in real time, information (eg, real-time candidate image information) necessary for test supervision including images of the test taker and the surrounding environment to the supervision server 202 , and the supervision server ( 202) may analyze the received information to supervise the test taker's gaze situation in real time. The supervision server 202 may transmit the information received from the second external electronic device to the test supervision electronic device, and if necessary, store the information received from the second external electronic device in a memory.

The third external electronic device 300 may be a supervisor's electronic device. According to various embodiments, the third external electronic device 300 includes a communication module (eg, the communication module 190 of FIG. 1 ), a processor (eg, the processor 120 of FIG. 1 ), and a display (eg, of FIG. 1 ). The display module 160) and an input module (eg, the input module 150 of FIG. 1 ) may be included. Referring to FIG. 2 , the third external electronic device may include an electronic device 205 for test management and an electronic device 206 for test supervision. The electronic device for test management and the electronic device for test supervision may each operate as independent devices, but are not limited thereto, and may be included in one electronic device (eg, a third external electronic device) to operate.

According to various embodiments, the third external electronic device may be a device (eg, an electronic device for test management) used to manage test progress in order to assist a test taker smoothly in taking a test. According to various embodiments, the supervisor may receive information (eg, test taker information) related to the test taker's test taking from the test server 201 through the third external electronic device 300 , and if necessary, the third external electronic device The device 300 may be used to transmit necessary information to the first external electronic device through the gaze server 201 (eg, a remote control signal). According to various embodiments, the above-described operation performed by the supervisor may be an operation of the third external electronic device. For example, a supervisor may not exist, and the processor of the third external electronic device 300 may perform an operation of the supervisor. The gaze server 201 may transmit information received from the first external electronic device to the third external electronic device 300 , and may transmit information received from the third external electronic device to the first external electronic device.

According to various embodiments, the third external electronic device 300 may be a device (eg, an electronic device for test supervision) for supervising test takers in order to prevent cheating. For example, the third external electronic device 300 may be a device necessary for receiving information required for test supervision from the supervision server 202 and for a supervisor to check the received information. According to various embodiments, the second external electronic device 204 may transmit various information necessary for test supervision including real-time test taker image information to the supervision server 202 , and the third external electronic device 300 may transmit the test taker image information to the supervision server. It is possible to receive various information necessary for supervision in real time from According to various embodiments, the third external electronic device analyzes real-time candidate image information by the supervisory server using an artificial intelligence algorithm, and transmits notification information (eg, candidate abnormality information) to the supervisory server when there is an abnormality in the analysis result. can receive

Each operation of the supervisor and/or the third external electronic device 300 described above may be replaced with an operation of the server 200 . For example, the server may directly determine whether remote control of the first external electronic device is required, and may generate and transmit a remote control signal to the first external electronic device.

3 is a block diagram of a server 200 according to various embodiments.

Referring to FIG. 3 , the server 200 may include a communication interface 210 , a memory 220 , and a processor 230 . According to various embodiments, the server 200 may operate as a gaze server (eg, gaze server 201 of FIG. 2 ), and may simultaneously operate as a supervisor server (eg, supervisor server 202 of FIG. 2 ). The server 200 may include at least some of the configuration and/or functions of the electronic device 101 of FIG.

The communication interface 210 is a software and/or hardware module (eg, a communication processor (CP) for wired/wireless communication with a network or an external electronic device (eg, each external electronic device 203 , 204 , 300 of FIG. 2 )). )), and may include at least some of the configuration and/or functions of the communication module 190 of FIG. 1 . The communication interface 210 is connected to an external electronic device (eg, each of the external electronic devices 203 and 204 in FIG. 2 ) through a wired/wireless communication network (eg, the first network 198 or the second network 199 of FIG. 1 ). , 300)). According to various embodiments, the communication interface 210 may transmit data provided from the processor 230 to an external electronic device, or may receive data from the external electronic device and provide it to the processor 230 .

The memory 220 may store various data used by at least one component (eg, the processor 230 ) of the server 200 . The data may include, for example, input data or output data for software (eg, the program 140 of FIG. 1 ) and instructions related thereto. According to various embodiments, the memory 220 may include a database 221 that stores various information (eg, applicant information) required for test taking and supervision. According to various embodiments, the memory 220 may store instructions related to various operations of the processor 230 for test supervision. For example, when executed, the processor may store instructions for an operation of analyzing real-time candidate image information using an artificial intelligence algorithm. According to various embodiments, the processor may store image information parameters used to analyze candidate image information using an artificial intelligence algorithm.

The processor 230 may process data in the server 200 and control at least one other component related to providing the online test, and may perform data processing and calculation required for providing the online test. The processor 230 may include at least some of the functions and/or configurations of the processor 120 of FIG. 1 . The processor 230 may be electrically and/or functionally connected to components of the server 200 such as the communication interface 210 and the memory 220 . According to various embodiments, the processor 230 may operate according to instructions stored in the memory 220 . According to various embodiments, there will be no limitations on the arithmetic and data processing functions that the processor 230 can implement in the server 200 , but in the present specification, the detailed description of the processor 230 for providing an online test of the server 200 is provided. We will focus on the action.

The processor 230 may transmit various information (eg, test question information) for providing the online exam to the first external electronic device (eg, the first external electronic device 203 of FIG. 2 ), and the first external electronic device Information for performing an online test (eg, information on test status) may be received from the device. According to various embodiments, the processor may receive candidate information from the first external electronic device. Candidate information, for example, may include information necessary for taking the test, and may include the name of the test taker, test number, date of birth, and a special code (eg, test code) for taking the test. According to various embodiments, the processor 230 may authenticate the candidate information. For example, the test taker information authentication may be checking whether the test taker information and the applicant information match. According to various embodiments, the processor may authenticate the candidate information by comparing whether the applicant information stored in the database 221 of the memory 220 matches the candidate information received from the first external electronic device. According to various embodiments, the applicant information may include the applicant's name, application number, date of birth, a special code assigned to the applicant (eg, application code), and photo information of the applicant. According to various embodiments, the processor transmits a special code required for authentication to each applicant's electronic device (eg, the second external electronic device 204 of FIG. 2 , the applicant's portable terminal) before a predetermined time from the test time. and the processor may store the transmitted special code as applicant information. According to various embodiments, the processor may compare at least a portion of the applicant information and at least a portion of the candidate information to determine whether they match, and if they match, determine that the candidate information is authenticated.

According to various embodiments of the present disclosure, the processor may transmit information required to perform the test to the test taker's electronic device for which the test taker information is authenticated (eg, the first external electronic device 203 of FIG. 2 ). For example, the processor may transmit test question information required for taking the test to the first external electronic device. The processor may sequentially and continuously transmit test question information to the first external electronic device while taking the test is in progress. According to various embodiments, the test question information may include various information and/or combinations thereof, such as information related to the test question, for example, item number, test question, auxiliary material, optional question view information, short answer/descriptive input box information, etc. can According to various embodiments, the test question information may include an instruction for outputting information about the test question to the first external electronic device. For example, the processor transmits data (eg, a test question file) including information related to the entire test question to the first external electronic device, and outputs it in response to a predetermined condition (eg, when checking a response to a specific question) may be transmitted to the first external electronic device to sequentially proceed or stop. According to various embodiments, the processor may stop transmitting test question information when it is determined that there is an obstacle in test execution, for example, when an abnormal state is detected, such as execution of an unauthorized program of the first external electronic device.

According to various embodiments, when the candidate information of the first external electronic device is authenticated, the processor may receive the gaze status information from the first external electronic device. The test test status information may be information indicating a test taker's test taking status. According to various embodiments, the exam status information may include communication status information of the first external electronic device, remaining test time information of the first external electronic device, and candidate information. According to various embodiments, the processor may receive and monitor gaze status information. For example, the communication state information of the first external electronic device may be monitored, and it may be checked whether there is an abnormality in the network communication state of the first external electronic device. According to various embodiments, the processor may transmit the received gaze status information to the third external electronic device 300 . For example, the processor may transmit the gaze status information to the third external electronic device in real time, and monitor the gaze status information to check whether there is an abnormality. The processor may transmit a signal indicating whether there is an abnormality to the third external electronic device.

The processor may receive answer information from the first external electronic device. According to various embodiments, the processor may transmit test question information to the first external electronic device in which the candidate information is authenticated, and receive answer information transmitted by the first external electronic device in response to the test question information. The answer information may include, for example, various information such as a question number, answer selection information, input text information, and/or a combination thereof. The processor may store the answer information received from the first external electronic device in the memory 220 and transmit the answer information to the third external electronic device.

The processor may receive various information necessary for test supervision including real-time test taker image information from the external electronic device. According to various embodiments, the processor may receive real-time candidate image information from the second external electronic device. The real-time test taker image information may be information about a real-time image of a test taker taking a test and a surrounding environment with the camera of the second external electronic device. According to various embodiments, the processor may receive real-time candidate image information and store the received real-time candidate image information in a memory. According to various embodiments, the processor may analyze the received real-time image information. For example, the processor may analyze real-time image information using an artificial intelligence algorithm stored in the memory, and may generate information about the candidate's behavior and/or the candidate's surrounding environment. According to various embodiments, the processor may transmit real-time candidate image information to the third external electronic device.

According to various embodiments, the processor may receive gaze status information from the first external electronic device. The exam status information may be information indicating a situation related to a test taker's test taking, and may include communication state information of the first external electronic device, remaining test time information of the first external electronic device, and test taker information. According to various embodiments, the processor may receive and monitor gaze status information. For example, the communication state information of the first external electronic device may be monitored, and it may be checked whether there is an abnormality in the network communication state of the first external electronic device.

According to various embodiments, the processor may transmit the received gaze status information to the third external electronic device 300 . For example, the processor may receive gaze status information from the first external electronic device in real time, and transmit the received gaze status information to the third external electronic device in real time. The processor may receive gaze status information of the first external electronic device It is possible to monitor in real time whether an anomaly has occurred in the information. According to various embodiments, when it is checked whether the gaze status is abnormal, the processor may transmit a signal informing of the abnormality to the third external electronic device.

According to various embodiments, when the processor receives the exam status information and checks whether the exam status is abnormal, the processor may stop transmitting the exam question information to the first external electronic device. For example, when the processor detects that there is an abnormality in the communication state of the first external electronic device (eg, a sharp decrease in network transmission/reception speed), the processor may stop the test question information until the abnormal state is released. The processor may record the time when checking whether there is an abnormality or when the test question information is stopped while interrupting the transmission of the test question information. According to various embodiments, the processor may determine whether the previously identified abnormal state is released. Even when the transmission of test question information is stopped, the processor may be in a state of continuously receiving test test status information. The processor may monitor the received gaze status information and determine whether the gaze status returns to a normal state. When the processor confirms that the abnormal state is released, the processor may resume transmitting problem information again. According to various embodiments, when the abnormal state is released, the processor may measure the time from when the previously recorded abnormality is checked or when the transmission of test question information is stopped to when the abnormal state is released or when the transmission of the problem information is resumed. According to various embodiments, the processor may further extend the remaining test time of the first external electronic device while resuming transmission of problem information. For example, the processor may extend the remaining test time of the first external electronic device by a time corresponding to when an abnormality is checked or when transmission of test question information is stopped to when an abnormal state is released or when transmission of problem information is resumed.

According to various embodiments, the processor may receive information necessary to supervise the test taker from the external electronic device. For example, the processor may receive real-time candidate image information regarding the candidate image captured by the second external electronic device. According to various embodiments, the processor may receive real-time candidate image information and analyze the received real-time candidate image information. For example, the processor may extract an image of the candidate from the real-time candidate image information, and may generate information about the candidate's behavior regarding the candidate's behavior and environment information about the candidate's surrounding environment using an artificial intelligence algorithm. According to various embodiments, the processor may analyze real-time candidate image information through an artificial intelligence algorithm using pre-stored image information parameters. The image information parameter may be, for example, parameter information for recognizing each object on the image information. According to various embodiments, parameters for recognizing objects such as the candidate's face, both hands, the first external electronic device being used by the candidate, and objects around the candidate in real-time candidate image information may be stored in advance as image information parameters in the memory. have. The processor may analyze real-time candidate image information using pre-stored parameters, and may recognize objects such as the candidate's face, both hands, an electronic device being used by the candidate, and objects around the candidate.

According to various embodiments, the processor may extract an image of a candidate from real-time candidate image information. For example, the candidate image extracted by the processor may be a face image of the candidate. The processor may determine whether the candidate is a suitable candidate using the extracted candidate image. According to various embodiments, the processor may compare the candidate image extracted from the real-time candidate image information with the applicant's photo information among the applicant information stored in the memory, and determine whether they match. According to various embodiments, when the extracted candidate image and applicant information do not match, the processor may transmit a signal informing that there is an abnormality in the candidate to the third external electronic device. According to various embodiments of the present disclosure, when the candidate image and applicant information do not match, the processor may transmit a warning message to the first external electronic device and stop transmitting test question information.

According to various embodiments, the processor may check the image information parameter and real-time candidate image information, and analyze the real-time candidate image information using an artificial intelligence algorithm. As a result of analyzing the real-time candidate image information, the processor may generate information about the candidate's behavior and/or information about an environment surrounding the candidate. According to various embodiments, the processor may analyze real-time candidate image information through an artificial intelligence algorithm using pre-stored image information parameters. According to various embodiments, the processor may recognize each object including the candidate and surrounding objects in the real-time candidate image information, and may analyze the behavioral pattern of the candidate. According to various embodiments, the processor may analyze the real-time test taker image information to generate test taker behavior information and/or environment information surrounding the test taker. The test taker behavior information may be information about the body movement of the test taker, for example, information about the gaze of the test taker, the movement of the test taker's hand, and the location. The environment information around the test taker may be information about an object around the test taker, for example, information about the type and location of an object existing around the test taker.

According to various embodiments, the processor may determine whether the generated test taker behavior information and/or the test taker surrounding environment information is out of a range of pre-stored staring conditions. The information about the gaze condition range may include information about the candidate's behavioral range corresponding to the candidate's behavioral information, and may include information about allowable surrounding objects corresponding to the candidate's surrounding environment information. According to various embodiments, the processor may compare the candidate behavior information generated as a result of analyzing the real-time candidate image information with the candidate behavior range information, and determine whether the candidate behavior information is out of the gaze condition range. According to various embodiments of the present disclosure, the processor may compare the generated information about the candidate's surrounding environment with the allowable surrounding object information, and determine whether the information about the candidate's surrounding environment is out of the range of the gaze condition. For example, the processor may determine the behavior of the test taker leaving the seat, the case where the test taker places an electronic device that is not allowed in the vicinity, and the like.

According to various embodiments, when it is determined that the test taker behavior information and/or the environment information surrounding the test taker are out of the range of the staring condition, the processor may transmit a signal notifying that there is an abnormality in the test taker to the third external electronic device. According to various embodiments, when the test taker behavior information and/or the test taker surrounding environment information is out of the range of the test conditions, the processor may transmit a warning message to the first external electronic device and stop transmitting the test question information. According to various embodiments of the present disclosure, when out of the range of the gaze condition, the processor may capture an image frame at a point in time when an abnormality occurs among real-time candidate image information, and may separately store information about the captured image in a memory.

According to various embodiments, the processor may remotely control the candidate's electronic device. For example, the processor may transmit a remote control signal to the first external electronic device and perform remote control of the first external electronic device. According to various embodiments, the processor may receive a signal related to remote control of the first external electronic device from the third external electronic device. The signal related to remote control may include, for example, a signal from the third external electronic device 300 requesting remote control of the first external electronic device 203 to the server 200 and/or a signal from the third external electronic device 1 It may be a control signal for controlling an external electronic device.

According to various embodiments, the processor may record the time when the remote control is started. The remote control start time may mean, for example, a time at which a remote control signal is received or a time at which the remote control signal is transmitted to the first external electronic device. The processor may check the remote control start time, record it, and store it in memory in advance.

According to various embodiments, the processor may transmit a remote control signal to the first external electronic device. According to various embodiments, the processor may transmit a signal transmitted by the third external electronic device to the first external electronic device to control the first external electronic device, and separately for the processor to directly remotely control the first external electronic device. may generate an instruction of , and transmit it to the first external electronic device.

According to various embodiments, the processor determines whether the remote control is terminated. For example, whether the remote control signal reception from the third external electronic device is terminated may be determined based on whether the remote control is terminated, and the remote control may be determined to be terminated by receiving the remote control termination signal from the third external electronic device. . When the remote control is terminated, the processor may check the remote control termination time. According to various embodiments of the present disclosure, the processor may determine the time when the reception of the remote control signal is finished or the time when the remote control end signal is received as the remote control end time. The processor may measure a remote control time at which the total remote control is performed using the remote control start time and the remote control end time. According to various embodiments, the processor may extend the remaining test time of the first external electronic device by a time corresponding to the measured remote control time.

4 is an operation flowchart of a server that provides an online test according to various embodiments of the present disclosure;

Referring to FIG. 4 , each operation of the flowchart shown in FIG. 4 may be understood as each operation of the server (eg, the server 200 of FIG. 2 ), and specifically, the processor of the server (eg, the processor of FIG. 3 ) 230))).

In operation 410, the processor may receive candidate information. According to various embodiments, the processor may receive candidate information from the first external electronic device. Candidate information, for example, may be information for authenticating whether the candidate is qualified to take the exam, and may include candidate personal information for taking the exam input by the candidate. Candidate information may include information necessary for taking the test, and may include the name of the test taker, test number, date of birth, and a special code (eg, test code) issued individually for taking the test.

In operation 420, the processor may authenticate the candidate information. For example, the test taker information authentication may be checking whether the test taker information and the applicant information match. According to various embodiments, the processor may authenticate the candidate information by comparing whether the applicant information stored in the database 221 of the memory 220 matches the candidate information received from the first external electronic device. According to various embodiments, the applicant information may include the applicant's name, application number, date of birth, a special code assigned to the applicant (eg, application code), and photo information of the applicant. According to various embodiments, the processor transmits a special code required for authentication to each applicant's electronic device (eg, the second external electronic device 204 of FIG. 2 , the applicant's portable terminal) before a predetermined time from the test time. and the processor may store the transmitted special code as applicant information. According to various embodiments, the processor may compare at least a portion of the applicant information and at least a portion of the candidate information to determine whether they match, and if they match, determine that the candidate information is authenticated. If the candidate information is authenticated, the processor may proceed to operation 430 .

In operation 430, the processor may transmit information necessary for performing the test to the test taker's electronic device (eg, the first external electronic device 203 of FIG. 2 ) for which the test taker information is authenticated. For example, the processor may transmit test question information required for taking the test to the first external electronic device. The processor may sequentially and continuously transmit test question information to the first external electronic device while taking the test is in progress. According to various embodiments, the test question information may include various information and/or combinations thereof, such as information related to the test question, for example, item number, test question, auxiliary material, optional question view information, short answer/descriptive input box information, etc. can According to various embodiments, the test question information may include an instruction for outputting information about the test question to the first external electronic device. For example, the processor transmits data (eg, an exam question file) including information related to the entire exam question to the first external electronic device, and responds to a certain condition (eg, when checking responses to a specific question) An instruction for sequentially progressing or stopping the output of information may be transmitted to the first external electronic device. For example, the instruction may output problem information sequentially over time, or output problem information according to an answer preparation or a test taker's request for progress, and abnormal conditions such as cheating or poor communication Upon detection, it may include an instruction to stop outputting problem information according to a condition such as a request from a supervisor. According to various embodiments, the processor may stop transmitting test question information when it is determined that there is an obstacle in test execution, for example, when an abnormal state is detected, such as execution of an unauthorized program of the first external electronic device.

In operation 430, when the candidate information of the first external electronic device is authenticated, the processor may receive gaze status information from the first external electronic device. The test test status information may be information indicating a test taker's test taking status. According to various embodiments, the exam status information may include communication status information of the first external electronic device, remaining test time information of the first external electronic device, and candidate information. According to various embodiments, the processor may receive and monitor gaze status information. For example, the communication state information of the first external electronic device may be monitored, and it may be checked whether there is an abnormality in the network communication state of the first external electronic device. According to various embodiments, the processor may transmit the received gaze status information to the third external electronic device 300 . For example, the processor may transmit the gaze status information to the third external electronic device in real time, and monitor the gaze status information to check whether there is an abnormality. The processor may transmit a signal indicating whether there is an abnormality to the third external electronic device. The processor may synthesize the gaze status information received from the plurality of first external electronic devices to generate a table for simultaneously checking the gaze status information regarding a plurality of test takers, and transmit the table to the third external electronic device.

In operation 430, the processor may receive answer information from the first external electronic device. According to various embodiments, the processor may transmit test question information to the first external electronic device in which the candidate information is authenticated, and receive answer information transmitted by the first external electronic device in response to the test question information. The answer information may include, for example, various information such as a question number, answer selection information, input text information, and/or a combination thereof. The processor may store the answer information received from the first external electronic device in the memory 220 and transmit the answer information to the third external electronic device.

In operation 440, the processor may receive various information necessary for test supervision including real-time candidate image information from the external electronic device. According to various embodiments, the processor may receive real-time candidate image information from the second external electronic device. The real-time test taker image information may be information about a real-time image of a test taker taking a test and a surrounding environment with the camera of the second external electronic device. According to various embodiments, the processor may receive real-time candidate image information and store the received real-time candidate image information in a memory. According to various embodiments, the processor may transmit real-time candidate image information to the third external electronic device. For example, the processor may receive real-time candidate image information from the third external electronic device in real time and relay it so that it can be checked. According to various embodiments, the processor may receive real-time image information of a plurality of test takers, and provide a plurality of real-time image information of a plurality of test takers so that the real-time image information of the plurality of test takers can be integrated and checked.

5 is an example of displaying gaze status information according to various embodiments.

In order to manage the smooth test progress, the supervisor and/or the server may need to check the current status of the test taker. An example of the gaze status information of FIG. 5 may be gaze status information displayed on the screen of the third external electronic device. According to various embodiments, when the candidate information of the first external electronic device is authenticated, the processor may receive the gaze status information from the first external electronic device and transmit the received gaze status information to the third external electronic device. The test test status information may be information indicating a test taker's test taking status. According to various embodiments, the exam status information may include communication status information of the first external electronic device, remaining test time information of the first external electronic device, and candidate information.

6 is a flowchart illustrating an operation of a server when an exam status is abnormal in an online exam according to various embodiments of the present disclosure;

Each operation of the flowchart shown in FIG. 6 may be understood as each operation of the server (eg, the server 200 of FIG. 2 ), and specifically, as an operation of the server's processor (eg, the processor 230 of FIG. 3 ) can be done

In operation 610, the processor may receive gaze status information from the first external electronic device. The exam status information may be information indicating a situation related to a test taker's test taking, and may include communication state information of the first external electronic device, remaining test time information of the first external electronic device, and test taker information. According to various embodiments, the processor may receive and monitor gaze status information. For example, the communication state information of the first external electronic device may be monitored, and it may be checked whether there is an abnormality in the network communication state of the first external electronic device. According to various embodiments, the processor receives the gaze status information from the first external electronic device in real time and continuously transmits the gaze status information from the first external electronic device so that the third external electronic device can check the gaze status information in real time. It may receive and transmit to a third external electronic device at the same time. According to various embodiments, in operation 610 , the processor may transmit the received gaze status information to the third external electronic device 300 . For example, the processor may receive gaze status information from the first external electronic device in real time, and transmit the received gaze status information to the third external electronic device in real time.

In operation 620, the processor may monitor in real time whether an abnormality has occurred in the gaze status information of the first external electronic device. According to various embodiments, the processor may determine whether an abnormality has occurred in the gaze status based on gaze status information received from the first external electronic device (eg, a sharp decrease in network transmission/reception speed). For example, if it is impossible to perform the test because the communication state of the first external electronic device is not smooth in the exam status information, the processor may check this and determine whether the exam status is abnormal. According to various embodiments, when it is checked whether the gaze status is abnormal, the processor may transmit a signal informing of the abnormality to the third external electronic device.

In operation 630, when the processor receives the gaze status information and checks whether the gaze status is abnormal, the processor may stop transmitting the exam question information to the first external electronic device. For example, when the processor detects that there is an abnormality in the communication state of the first external electronic device (eg, a sharp decrease in network transmission/reception speed), the processor may stop the test question information until the abnormal state is released. The processor may record the time when checking whether there is an abnormality or when the test question information is stopped while interrupting the transmission of the test question information.

In operation 640, the processor may determine whether the previously identified abnormal state is released. Even when the transmission of test question information is stopped, the processor may be in a state of continuously receiving test test status information. The processor may monitor the received gaze status information and determine whether the gaze status returns to a normal state. When the processor confirms that the abnormal state is released, the processor may resume transmitting problem information again.

In operation 650, when the abnormal state is released, the processor may extend the remaining test time of the first external electronic device in which the abnormal state has occurred. When the abnormal state is released, the processor may measure the time from when the previously recorded abnormality is checked or when the transmission of test question information is stopped to when the abnormal state is released or when the transmission of the problem information is resumed. For example, in operation 630, transmission of test question information may be stopped, and a time at which the transmission of question information is stopped may be being measured. According to various embodiments, the processor may further extend the remaining test time of the first external electronic device while resuming transmission of problem information. For example, the processor may extend the remaining test time of the first external electronic device by a time corresponding to when an abnormality is checked or when transmission of test question information is stopped to when an abnormal state is released or when transmission of problem information is resumed.

7 is an example illustrating an online test supervision method according to various embodiments of the present disclosure;

Referring to FIG. 7 , the server 200 may receive real-time candidate image information from the second external electronic device 204 and transmit it to the third external electronic device 300 . The first external electronic device may photograph the candidate 710 and the first external electronic device 203 in real time, and transmit image information of the candidate photographed in real time to the server. According to various embodiments of the present disclosure, the third external electronic device may receive real-time candidate image information from the server, and output it so that a supervisor may check the photographed image of the candidate in real time. According to various embodiments, the server may process and analyze the received real-time candidate image information and utilize it as information necessary for supervision. For example, the processor may extract an image of the candidate from the real-time candidate image information, and may generate information about the candidate's behavior regarding the candidate's behavior and environment information about the candidate's surrounding environment using an artificial intelligence algorithm. According to various embodiments, the processor may analyze real-time candidate image information through an artificial intelligence algorithm using pre-stored image information parameters. The image information parameter may be, for example, parameter information for recognizing each object on the image information. According to various embodiments, parameters for recognizing objects such as the candidate's face, both hands, the first external electronic device being used by the candidate, and objects around the candidate in real-time candidate image information may be stored in advance as image information parameters in the memory. have. The processor may analyze real-time candidate image information using pre-stored parameters, and may recognize objects such as the candidate's face, both hands, an electronic device being used by the candidate, and objects around the candidate.

8 is a flowchart of an operation of a server related to supervision using a real-time candidate image according to various embodiments of the present disclosure;

Each operation of the flowchart shown in FIG. 8 may be understood as each operation of the server (eg, the server 200 of FIG. 2 ), and specifically, as an operation of the server's processor (eg, the processor 230 of FIG. 3 ) can be done

In operation 810, the processor may receive real-time candidate image information regarding the candidate image captured by the second external electronic device. According to various embodiments, the processor may receive real-time candidate image information and analyze the received real-time candidate image information.

In operation 820, the processor may extract an image of the candidate from the real-time candidate image information. For example, the candidate image extracted by the processor may be a face image of the candidate. According to various embodiments, the processor may synthesize the candidate's image information from a plurality of still frames included in the real-time candidate information, and extract the candidate's image information using pre-stored parameters and artificial intelligence algorithms.

In operation 830, the processor may determine whether the candidate is a suitable candidate using the extracted candidate image. According to various embodiments, the processor may compare the candidate image extracted from the real-time candidate image information with the applicant's photo information among the applicant information stored in the memory, and determine whether they match. According to various embodiments, when the extracted candidate image and applicant information do not match, the processor may transmit a signal indicating that there is an abnormality in the candidate to the third external electronic device (eg, in operation 870 ). According to various embodiments of the present disclosure, when the candidate image and applicant information do not match, the processor may transmit a warning message to the first external electronic device and stop transmitting test question information.

In operation 840, the processor may check the image information parameter and the real-time candidate image information, and analyze the real-time candidate image information using an artificial intelligence algorithm. As a result of analyzing the real-time candidate image information, the processor may generate information about the candidate's behavior and/or information about an environment surrounding the candidate. According to various embodiments, the processor may analyze real-time candidate image information through an artificial intelligence algorithm using pre-stored image information parameters. According to various embodiments, the processor may recognize each object including the candidate and surrounding objects in the real-time candidate image information, and may analyze the behavioral pattern of the candidate.

In operation 850, the processor may analyze the real-time test taker image information to generate test taker behavior information and/or environment information surrounding the test taker. The test taker behavior information may be information about the body movement of the test taker, for example, information about the gaze of the test taker, the movement of the test taker's hand, and the location. The environment information around the test taker may be information about an object around the test taker, for example, information about the type and location of an object existing around the test taker.

In operation 860, the processor may determine whether the generated test taker behavior information and/or the test taker surrounding environment information is out of a range of a pre-stored gaze condition. The information about the gaze condition range may include information about the candidate's behavioral range corresponding to the candidate's behavioral information, and may include information about allowable surrounding objects corresponding to the candidate's surrounding environment information. According to various embodiments, the processor may compare the candidate behavior information generated as a result of analyzing the real-time candidate image information with the candidate behavior range information, and determine whether the candidate behavior information is out of the gaze condition range. According to various embodiments of the present disclosure, the processor may compare the generated information about the candidate's surrounding environment with the allowable surrounding object information, and determine whether the information about the candidate's surrounding environment is out of the range of the gaze condition. For example, the processor may determine the behavior of the test taker leaving the seat, the case where the test taker places an electronic device that is not allowed in the vicinity, and the like.

In operation 870, when it is determined that the test taker behavior information and/or environment information surrounding the test taker are out of the range of the staring condition, the processor may transmit a signal notifying that there is an abnormality in the test taker to the third external electronic device. According to various embodiments, when the test taker behavior information and/or the test taker surrounding environment information is out of the range of the test conditions, the processor may transmit a warning message to the first external electronic device and stop transmitting the test question information. According to various embodiments, when the candidate image extracted in operation 830 does not match with the applicant information, the processor may transmit a signal notifying that there is an abnormality in the candidate to the third external electronic device. According to various embodiments of the present disclosure, when the candidate image and applicant information do not match, the processor may transmit a warning message to the first external electronic device and stop transmitting test question information. According to various embodiments of the present disclosure, when out of the range of the gaze condition, the processor may capture an image frame at a point in time when an abnormality occurs among real-time candidate image information, and may separately store information about the captured image in a memory.

9A, 9B, and 9C are examples of real-time candidate image information according to various embodiments of the present disclosure;

Referring to FIG. 9A , a real-time candidate image may be captured using the candidate's electronic device (eg, a second external electronic device). According to various embodiments of the present disclosure, the real-time candidate image captured using the second external electronic device 910 may be an image of a scene in which a candidate takes an exam and a surrounding environment within a predetermined range. For example, a real-time test taker image may be captured within a range in which certain parts of the test taker's body (eg, face and both hands) and an electronic device (eg, the first external electronic device) for the test taker can be checked. Referring to FIG. 9A , a real-time candidate image may be captured within an angle of view range 920 in which the candidate and the first external electronic device are photographed. According to various embodiments, the second external electronic device may capture a real-time candidate image and transmit real-time candidate image information on the captured real-time image to a server (eg, the server 200 of FIG. 2 ) in real time.

9B may be an example of real-time candidate image information captured by the second external electronic device and transmitted to the server. According to various embodiments, the server may analyze the received real-time candidate image information and recognize a specific object required for test supervision. For example, a specific body part of the candidate (eg, the candidate's face 930 and both hands 941 and 942), an electronic device for the candidate to take the test (eg, the first external electronic device 960) And as information about the surrounding environment, an object surrounding the candidate (eg, the object 960 around the candidate) may be recognized as a specific object. According to various embodiments, the processor of the server (eg, the processor 230 of FIG. 3 ) may analyze real-time image information and generate information about the candidate's behavior and/or information about the environment around the candidate. According to various embodiments, the processor may analyze real-time candidate image information by using an artificial intelligence algorithm, and may generate information about the candidate's behavior and/or environment around the candidate. For example, the processor may analyze the real-time test taker image information and monitor the test taker's behavior information and environment information around the test taker by using a part of the test taker's body and/or an object surrounding the test taker as a recognition target object in real time.

Referring to FIG. 9C , the processor may transmit real-time candidate image information to the supervisor's electronic device (eg, a third external electronic device). Referring to FIG. 9C , the real-time candidate image information received from the third external electronic device may be integrally displayed including real-time candidate image information for a plurality of test takers ( 960 ). According to various embodiments, the processor may transmit information in which a plurality of real-time candidate image information is integrated to the third external electronic device. According to an embodiment, the third external electronic device may integrate a plurality of real-time candidate image information received from the server and display it on the display.

10 is an operation flowchart of a server related to remote control in an online test according to various embodiments of the present disclosure;

Referring to FIG. 10, each operation of the flowchart shown in FIG. 10 may be understood as each operation of the server (eg, the server 200 of FIG. 2), and specifically, the processor of the server (eg, the processor of FIG. 3) 230))).

During the test, the test taker's electronic device may require remote control by the supervisor. For example, when a specific abnormality occurs, such as an error regarding the reception of test question information by the test taker's electronic device, the supervisor may try to solve the problem by remote control. According to various embodiments, the processor of the server may remotely control the candidate's electronic device. For example, the processor may transmit a remote control signal to the first external electronic device and perform remote control of the first external electronic device.

In operation 1010, the processor may receive a signal related to remote control of the first external electronic device from the third external electronic device. The signal related to remote control may include, for example, a signal from the third external electronic device 300 requesting remote control of the first external electronic device 203 to the server 200 and/or a signal from the third external electronic device 1 It may be a control signal for controlling an external electronic device.

In operation 1020, the processor may record a time at which remote control is started. The remote control start time may mean, for example, a time at which a remote control signal is received or a time at which the remote control signal is transmitted to the first external electronic device. The processor may check the remote control start time, record it, and store it in memory in advance.

In operation 1030, the processor may transmit a remote control signal to the first external electronic device. According to various embodiments, the processor may transmit a signal transmitted by the third external electronic device to the first external electronic device to control the first external electronic device, and separately for the processor to directly remotely control the first external electronic device. may generate an instruction of , and transmit it to the first external electronic device.

In operation 1040, the processor determines whether the remote control is terminated. For example, whether the remote control signal reception from the third external electronic device is terminated may be determined based on whether the remote control is terminated, and the remote control may be determined to be terminated by receiving the remote control termination signal from the third external electronic device. . When the remote control is terminated, the processor may proceed to operation 1050 .

In operation 1050, the processor may check the remote control end time. According to various embodiments of the present disclosure, the processor may determine the time when the reception of the remote control signal is finished or the time when the remote control end signal is received as the remote control end time. The processor may measure a remote control time at which the total remote control is performed using the remote control start time and the remote control end time.

In operation 1060, the processor may extend the remaining test time of the first external electronic device by a time corresponding to the measured remote control time. It may be necessary to extend the remaining test time of the test taker by the time the remote control is performed. According to various embodiments, the processor may extend the remaining test time by adding a time corresponding to the measured remote control time to the current remaining test time of the first external electronic device. The processor may store information about the extended remaining test time and transmit it to the third external electronic device and/or the first external electronic device.

In the electronic device according to various embodiments disclosed in this document, the electronic device includes a memory communication module including a database for storing applicant information, and a processor operatively connected to the communication module and the memory, wherein the processor includes: 1 Receive candidate information from an external electronic device and compare whether the candidate information and the applicant information stored in the memory match, and compare the applicant information, the candidate information, and the match with at least one second external electronic device one comparison result information is transmitted, and when the applicant information and the candidate information match as a result of comparing the match, the test question information is transmitted to the plurality of first external electronic devices, and from a plurality of third external electronic devices It may be configured to receive real-time test taker image information, store the real-time test taker image information in the memory, and transmit the real-time test taker image information to at least one electronic device for test supervision.

In addition, the processor is configured to receive gaze status information from the plurality of first external electronic devices and transmit the gaze status information to the second external electronic device, wherein the gaze status information includes the first external electronic device. It may include at least communication state information of the device, remaining test time information, and the candidate information.

In addition, the processor checks whether there is an abnormality based on the communication state information of the first external electronic device, stops transmitting the test question if there is an abnormality, and a time from when the abnormality is checked until the abnormality is released It can be set to measure and extend the remaining test time when the abnormality is cleared.

The processor may be configured to receive a remote control signal for a specific first external electronic device among the plurality of first external electronic devices from the second external electronic device, and transmit the remote control signal to the specific first external electronic device. It can be set to transmit.

In addition, the processor detects a program running in the first external electronic device, determines whether the running program is an allowed program, and stops transmitting the test question information if it does not correspond to the allowed program can be set to

In addition, the applicant information includes at least photo information of the applicant, and when the memory is executed, the processor analyzes the received real-time candidate image information to extract a candidate image, and the candidate image and the photograph information compare, and when the candidate image and the photo information do not match, transmit candidate image mismatch information to the test supervisor electronic device, and stop transmission of the test question information to the first external electronic device can be saved.

In addition, when the memory is executed, the processor checks a predefined image information parameter and the real-time candidate image information, and analyzes the real-time candidate image information based on the image information parameter using an artificial intelligence algorithm. and generates test taker behavior information and test taker surrounding environment information based on the analyzed real-time test taker image information. It is possible to store an instruction for transmitting the candidate anomaly information.

In addition, the pre-stored gaze condition range includes information on the candidate behavior range and the allowable surrounding object information, and the memory, when executed, causes the processor to compare the candidate behavior information with the candidate behavior range information, and the candidate behavior When the information is out of the test taker behavior range information, an instruction for transmitting the test taker abnormality information to the second external electronic device may be stored.

In addition, when the memory is executed, the processor compares the candidate surrounding environment information with the allowable surrounding object information, and when the candidate surrounding environment information deviates from the allowable surrounding object information, the candidate An instruction for transmitting abnormal information may be stored.

In addition, when the memory is executed, when the test taker behavior information and the test taker surrounding environment information are out of a pre-stored staring condition range, the memory captures the real-time test taker image to generate a captured image, and electronic for test supervision and store instructions to send the captured image to the device and stop sending the test question.

In the method of providing an online test by an electronic device according to various embodiments disclosed herein, the test taker information is received from a plurality of first external electronic devices and the test taker information is compared with the applicant information stored in the memory. transmitting the applicant information, the candidate information, and the comparison result information comparing the match to at least one second external electronic device; transmitting test question information to the plurality of first external electronic devices, receiving real-time test taker image information from a plurality of third external electronic devices, storing the real-time test taker image information in a memory, and storing the real-time test taker image information at least It may include transmitting to one electronic device for test supervision.

The method may further include receiving gaze status information from the plurality of first external electronic devices and transmitting the gaze status information to the second external electronic device, wherein the gaze status information includes: It may include at least communication state information of the device, remaining test time information, and the candidate information.

In addition, based on the communication state information of the first external electronic device, checking whether there is an abnormality, stopping the transmission of the test question if there is an abnormality, and measuring the time from when the abnormality is checked until the abnormality is released, , it may further include the step of extending the remaining test time when the abnormality is released.

In addition, receiving a remote control signal for a specific first external electronic device among the plurality of first external electronic devices from the second external electronic device and transmitting the remote control signal to the specific first external electronic device may include.

In addition, the steps of detecting a program running in the first external electronic device, determining whether the running program is an allowed program, and transmitting the test question information if the running program does not correspond to the permitted program Electronic devices set to stop

In addition, the applicant information includes at least photo information of the applicant, and the method includes extracting a candidate image by analyzing the received real-time candidate image information, comparing the candidate image with the photographic information, and the candidate image and when the photograph information does not match, transmitting the candidate image mismatch information to the test supervisor electronic device and stopping the test question information transmission to the first external electronic device.

In addition, checking the predefined image information parameter and the real-time candidate image information Analyzing the real-time candidate image information based on the image information parameter using an artificial intelligence algorithm Based on the analyzed real-time candidate image information Generating the test taker behavior information and the test taker surrounding environment information, and when the test taker behavior information and the test taker surrounding environment information are out of a pre-stored test condition range, transmitting the test taker abnormality information to an electronic device for test supervision. have.

In addition, the pre-stored gaze condition range includes information on a candidate behavioral range and allowable surrounding object information, the method includes comparing the candidate behavior information with the candidate behavioral range information, wherein the candidate behavior information is the candidate behavioral range information The method may further include transmitting the candidate abnormality information to the second external electronic device when it is out of .

The method may further include comparing the information about the candidate's surrounding environment with the allowable surrounding object information, and transmitting the candidate abnormality information to a second external electronic device when the candidate's surrounding environment information is out of the allowable surrounding object information. have.

In addition, when the test taker behavior information and the test taker surrounding environment information are out of a pre-stored test condition range, the real-time test taker image is captured to generate a captured image, and the captured image is transmitted to an electronic device for test supervision, and the test It may further include the step of stopping sending the problem.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other components in question, and may refer to components in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When mentioned, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). may be implemented as software (eg, the program 140) including For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one of one or more instructions stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term refers to the case where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store™) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly or online between smartphones (eg: smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Claims (20)

In an electronic device,
a memory including a database storing applicant information;
communication module; and
a processor operatively coupled to the communication module and memory;
The processor is
receiving candidate information from a plurality of first external electronic devices and comparing whether the candidate information and the applicant information stored in the memory match;
transmitting, to at least one second external electronic device, information on a comparison result obtained by comparing the applicant information, the candidate information, and the match;
When the applicant information and the candidate information match as a result of comparing the match, test question information is transmitted to the plurality of first external electronic devices;
An electronic device configured to receive real-time test taker image information from a plurality of third external electronic devices, store the real-time test taker image information in the memory, and transmit the real-time test taker image information to at least one electronic device for test supervision. According to claim 1,
The processor is
receiving gaze status information from the plurality of first external electronic devices;
set to transmit the gaze status information to the second external electronic device;
The application status information is,
The electronic device comprising at least communication state information of the first external electronic device, remaining test time information, and the candidate information. 3. The method of claim 2,
The processor is
Based on the communication state information of the first external electronic device, check whether there is an abnormality, stop transmitting the test question if there is an abnormality, measure the time from when the abnormality is checked until the abnormality is released, and whether there is an abnormality An electronic device set to extend the remaining test time when is released. According to claim 1,
The processor is
receiving a remote control signal for a specific first external electronic device among the plurality of first external electronic devices from the second external electronic device;
an electronic device configured to transmit the remote control signal to the specific first external electronic device. According to claim 1,
The processor is
The electronic device is configured to detect a program being executed in the first external electronic device, determine whether the running program is an allowed program, and stop transmitting the test question information if it does not correspond to the allowed program. According to claim 1,
The applicant information includes at least photo information of the applicant,
The memory, when executed, causes the processor to:
extracting a candidate image by analyzing the received real-time candidate image information,
comparing the candidate image with the photo information,
Electronic device that stores an instruction for transmitting candidate image mismatch information to the electronic device for test supervision and stopping transmission of the test question information to the first external electronic device when the candidate image and the photo information do not match Device. According to claim 1,
The memory, when executed, causes the processor to:
Check the predefined image information parameter and the real-time candidate image information,
Analyze the real-time candidate image information based on the image information parameter using an artificial intelligence algorithm,
Generate test taker behavior information and test taker surrounding environment information based on the analyzed real-time test taker image information,
An electronic device storing an instruction for transmitting the test taker abnormality information to an electronic device for test supervision when the test taker behavior information and the test taker surrounding environment information are out of a pre-stored test condition range. 8. The method of claim 7,
The pre-stored gazing condition range includes information on the candidate's behavioral range and permissible surrounding object information,
The memory, upon execution, the processor
An electronic device storing an instruction to compare the candidate behavior information and the candidate behavior range information, and to transmit the candidate abnormality information to a second external electronic device when the candidate behavior information is out of the candidate behavior range information. 9. The method of claim 8,
The memory, upon execution, the processor
An electronic device storing instructions for comparing the information about the candidate's surrounding environment with the allowable surrounding object information, and transmitting the candidate abnormality information to a second external electronic device when the candidate's surrounding environment information is out of the allowable surrounding object information. 8. The method of claim 7,
The memory, upon execution, the processor
When the test taker behavior information and the test taker's surrounding environment information are out of a pre-stored test condition range, the real-time test taker image is captured to generate a captured image, and the captured image is transmitted to an electronic device for test supervision, and the test question is transmitted An electronic device that stores instructions to abort. A method of providing an online exam on an electronic device, comprising:
receiving candidate information from a plurality of first external electronic devices and comparing whether the candidate information and the candidate information stored in the memory match;
transmitting, to at least one second external electronic device, the applicant information, the candidate information, and comparison result information comparing the match;
transmitting test question information to the plurality of first external electronic devices when the applicant information and the test taker information match as a result of comparing the match; and
A method, comprising: receiving real-time test taker image information from a plurality of third external electronic devices, storing the real-time test taker image information in a memory, and transmitting the real-time test taker image information to at least one electronic device for test supervision. 12. The method of claim 11,
receiving gaze status information from the plurality of first external electronic devices; and
Further comprising the step of transmitting the gaze status information to the second external electronic device,
The application status information is,
The method comprising at least communication state information of the first external electronic device, remaining test time information, and the candidate information. 13. The method of claim 12,
checking whether there is an abnormality based on the communication state information of the first external electronic device, and stopping transmission of the test question if there is an abnormality; and
The method further comprising the step of measuring a time from when the abnormality is confirmed until the abnormality is released, and when the abnormality is released, extending the remaining test time. 12. The method of claim 11,
receiving a remote control signal for a specific first external electronic device among the plurality of first external electronic devices from the second external electronic device; and
and transmitting the remote control signal to the specific first external electronic device. 12. The method of claim 11,
detecting a program running in the first external electronic device;
determining whether the running program is an allowed program; and
An electronic device configured to stop transmitting the test question information when the running program does not correspond to an allowed program 12. The method of claim 11,
The applicant information includes at least photo information of the applicant,
The method is
extracting a candidate image by analyzing the received real-time candidate image information;
comparing the candidate image with the photo information; and
and, when the candidate image and the photo information do not match, transmitting candidate image mismatch information to the test supervisor electronic device and stopping transmission of the test question information to the first external electronic device. 12. The method of claim 11,
checking a predefined image information parameter and the real-time candidate image information;
analyzing the real-time candidate image information based on the image information parameter using an artificial intelligence algorithm;
generating test taker behavior information and test taker surrounding environment information based on the analyzed real-time test taker image information; and
and transmitting the test taker abnormality information to an electronic device for test supervision when the test taker behavior information and the test taker surrounding environment information are out of a pre-stored test condition range. 18. The method of claim 17,
The pre-stored gazing condition range includes information on the candidate's behavioral range and permissible surrounding object information,
The method is
Comparing the test taker behavior information and the test taker behavior range information, and when the test taker behavior information is out of the test taker behavior range information, transmitting the test taker abnormality information to a second external electronic device. 19. The method of claim 18,
Comparing the information about the candidate's surrounding environment with the allowable surrounding object information, and transmitting the candidate abnormality information to a second external electronic device when the candidate's surrounding environment information is out of the allowable surrounding object information. 18. The method of claim 17,
When the test taker behavior information and the test taker's surrounding environment information are out of a pre-stored test condition range, the real-time test taker image is captured to generate a captured image, and the captured image is transmitted to an electronic device for test supervision, and the test question is transmitted A method further comprising the step of aborting.

Images