WO2015020246A1

WO2015020246A1 - Examinee terminal, examination management server, method for conducting examination by examinee terminal, and method for analyzing examination by examination management server

Info

Publication number: WO2015020246A1
Application number: PCT/KR2013/007116
Authority: WO
Inventors: 홍태운; 김민; 이미영
Original assignee: 이투스교육 주식회사
Priority date: 2013-08-07
Filing date: 2013-08-07
Publication date: 2015-02-12

Abstract

The present invention provides a device and a method capable of providing actual problem solving training and problem solving habit corrections using an examinee terminal comprising: an input unit for receiving answers inputted by an examinee to prepare for an objective examination; a display unit for displaying at least one of an examination sheet, which has been generated on the basis of examination sheet setup information, and an answer sheet, which has been generated on the basis of answer sheet setup information, and displaying answers, which are inputted by the examinee, on at least one of the examination sheet and the answer sheet; a control unit for measuring time taken per question, which is taken for the examinee to input an answer to each question with regard to each question; and a communication unit for transmitting examinee examination information to an examination management server, the examinee examination information comprising information regarding answers inputted by the examinee and information regarding the time taken per question.

Description

Examination method of the examinee terminal, test management server, examinee terminal, and test management server

The present invention relates to an apparatus and method that can provide practice problem solving training and problem solving habit correction using the examinee's terminal to prepare for the multiple choice test.

Currently, test papers are provided in the process of performing grades in elementary, middle and high schools, college entrance examinations, mathematics skills assessments, various national qualification tests, and driver's license tests, and OMR (Optical Mark Reader) cards are mainly used for writing multiple-choice answers. .

Candidates preparing for entrance examinations and qualification exams require training in problem-solving as well as learning. However, there is no way to practice problem-solving as in practice, except for the opportunity to take mock exams intermittently provided by specific institutions.

Even in the practice test, only the result information on the achievement score is provided, and the wrong habits and errors in the problem solving method cannot be identified. For example, proper time allocation may be important in the test, as well as in solving the correct answers. However, test papers to date and a mock exam using an OMR card can only know the final result, not how long the candidate has allocated for each question.

SUMMARY OF THE INVENTION The present invention has been made to overcome the above problems, and an object of the present invention is to provide an apparatus and a method capable of practice training and problem solving habit correction training in learners and educational institutions.

One embodiment of the present invention, an input unit for receiving an answer input by the examinee; An indicator for displaying at least one of an answer sheet generated based on the test sheet and answer sheet setting information, and displaying an answer input by the examinee on at least one of the test sheet and the answer sheet; A controller for measuring the time required for each item for the examinee to input the answer of each item for each item; And a communicator for transmitting the examinee test information including the information on the answer input by the examinee and the time required for each question to the test management server.

One embodiment of the present invention, a communication unit for receiving information from the examinee terminal the answer of the examinee input; And a grader that scores and analyzes the score based on the examinee's test information including the information on the answer entered by the examinee and the time required for each question taken by the examinee to input the answer of each question. Provide a management server.

An embodiment of the present invention, a test progress method that is executed in the examinee's terminal, comprising: displaying at least one of the test sheet and the answer sheet; Receiving an answer input by the examinee and displaying an answer input by the examinee; Measuring the time required for each item by the examinee for inputting the answer of each item for each item; And transmitting examinee test information including the information on the answer input by the examinee and information about the time required for each question to each test management server for each question. do.

In one embodiment of the present invention, a test analysis method executed in a test management server, the method comprising: receiving information of an answer input by an examinee from the examinee terminal; And scoring and analyzing the examinee based on the examinee's test information including information on the answer entered by the examinee and the time required for each question taken by the examinee to input the answer of each question. Provides test analysis method of server.

According to the present invention described above, it is possible to practice training and problem solving habit correction training in learners and educational institutions.

1 is a diagram illustrating a system to which an embodiment of the present invention can be applied.

FIG. 2 is a block diagram illustrating a configuration of an examinee terminal in FIG. 1.

3 is a diagram illustrating a test sheet and an OMR answer sheet displayed on the examinee terminal in the first embodiment.

4 and 5 are diagrams for explaining a method for measuring the time required for each item.

6 and 7 are diagrams illustrating data transferred from the examinee terminal to the test management server.

8 is a block diagram showing the configuration of a test management server in FIG.

9 and 10 are diagrams illustrating a solution pattern inquiry screen.

11 is a diagram illustrating detailed pattern analysis for each item.

12 is a flowchart showing a method according to the first embodiment.

FIG. 13 is a diagram illustrating a gaze information input screen displayed on the examinee terminal in the second embodiment.

FIG. 14 is a diagram illustrating an OMR answer sheet displayed on the examinee terminal in the second embodiment.

FIG. 15 is a diagram illustrating a gaze result screen displayed on the examinee terminal in the second embodiment.

16 is a diagram illustrating a scoring screen displayed on the examinee terminal in the second embodiment.

17 is a flowchart showing a method according to the second embodiment.

Hereinafter, some embodiments of the present invention will be described in detail through exemplary drawings. In adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are assigned to the same components as much as possible even though they are shown in different drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

In addition, in describing the component of this invention, terms, such as 1st, 2nd, A, B, (a), (b), can be used. These terms are only for distinguishing the components from other components, and the nature, order or order of the components are not limited by the terms. If a component is described as being "connected", "coupled" or "connected" to another component, that component may be directly connected to or connected to that other component, but there may be another configuration between each component. It is to be understood that the elements may be "connected", "coupled" or "connected".

1 is a diagram illustrating a test system to which an embodiment of the present invention is applied.

Referring to FIG. 1, the test system includes a examinee terminal 10 provided to the examinee, a test management server 20 connected to the examinee terminal 10 through a network 30, and a test management server 20 through a network. It includes a connected instructor terminal 40.

The examinee terminal 10 is a terminal provided to each examinee. The examinee terminal 10 may be a desktop computer, a laptop computer, a tablet PC, a PDA, a smartphone, or the like as an electronic device capable of communicating through a network, but is not limited thereto. The examinee terminal 10 may be a dedicated device for testing provided by the test coordinator, or may be a general purpose device provided by the test coordinator or owned by the examinee and equipped with an application for testing.

The examinee terminal 10 implements a digital OMR answer sheet of the same or similar design as the actual optical mark reader (OMR) card. The examinee may input the answer using the OMR answer sheet of the examinee terminal 10 during the simulation test or problem solving learning process.

Alternatively, the examinee terminal 10 implements a digital test paper of the same or similar design as the actual test paper. The examinee may input an answer using a test paper of the examinee terminal 10 in a simulation test or a problem solving learning process.

Alternatively, the examinee terminal 10 may simultaneously implement the digital OMR answer sheet and the digital test sheet.

The test management server 20 may transmit at least one of setting information of the OMR answer sheet and setting information of the test sheet to the examinee terminal 10. In addition, the test management server 20 may receive information related to content input to at least one of the OMR answer sheet and the test paper of the examinee terminal 10. The test management server 20 may score based on the OMR answer sheet related information or received from the examinee terminal 10, and may also analyze the problem solving habits of each examinee. Content analyzed by the test management server 20 may be delivered to the instructor terminal 40 to be used for training of the instructor.

The network 30 connecting the examinee terminal 10 and the test management server 20 may be a wired or wireless internet network. Alternatively, the network 30 may include the Institute of Electrical and Electronics Engineers (IEEE ) 802.15.x, Zigbee, Internet Engineering Task Force (IETF) Routing Over Low Power and Lossy networks (ROLL), International Society of Automation (ISA) 100.11a, and the like. The same may be a personal area network (PAN) or a local area network (LAN) such as a power line communication (PLC), a meter-BUS (M-BUS), a wireless M-BUS, a KNX, or the like.

Referring to FIG. 2, the examinee terminal 10 includes a communication unit 110 for communicating with the test management server 20 through the network 30, an input unit 120 for receiving an answer input by the examinee, a test sheet, and an answer sheet. And a display unit 130 for displaying at least one of the test sheets and the answer sheet, and a control unit 140 for displaying the answers input by the examinee.

The input unit 120 may include an input device used in an electronic device such as a mouse, a touch screen, a keypad, and the like. The examinee may input an answer through the input unit 120.

The display unit 130 may display a test sheet or an answer sheet in an OMR format. The test sheet or answer sheet displayed on the display unit 130 may be generated based on the test sheet setting information or the answer sheet setting information received from the test management server 20 through the communication unit 110. For example, the test sheet setting information may include information about test subjects, questions, and answers for each item, and the answer sheet setting information may include information about test subjects, the number of questions, and the number of questions per item. In addition, the display unit 130 may display an answer input by the examinee through the input unit 120. When the touch screen is used, the input unit 120 and the display unit 130 may have the same configuration.

3 is a diagram illustrating a screen displayed on the display unit 130 of the examinee terminal in the first embodiment.

Referring to FIG. 3, the OMR answer sheet displayed on the display unit 130 includes an initial screen 200, an answer sheet screen 300, and / or a test sheet screen 400.

The initial screen 200 may include a test type selection window 210, a test selection window 220, a sentence selection window 230, and a test taking button 240. The test type selection window 210 is a window for selecting a type of test (for example, a mock test) or a test subject. The test selection window 220 is a window in which detailed information on a test (for example, a test organization, etc.) can be selected. The sentence selection window 230 is a window in which a test sentence (odd or even) may be selected. The test taking button 240 is a button for taking a test after the examinee selects a test type selection window 210, a test selection window 220, a sentence selection window 240, and the like. The test type selection window 210, the test selection window 220, the sentence selection window 230, and the test taking button 240 described above are just examples, and the present invention is not limited thereto.

In an example, when the examinee presses the test taking button 240, the display unit 130 may be switched to the answer sheet screen 300 or the test sheet screen 400.

Alternatively, the initial screen may include a QR code window (not shown). The QR code window may display a QR code photographed by a camera (not shown) of the examinee terminal 10. The QR code photographed by the examinee terminal 10 may be displayed on data (for example, test paper) provided to the examinee. When the QR code is displayed on the QR code window, the display unit 130 may be switched to the answer sheet screen 300 or the test paper screen 400 corresponding to the QR code.

Referring to FIG. 3, the answer sheet screen 300 may include a question number 310, an answer field 320 for each item, a re-solve check box 330 for each item, and a check box 340 for each item later. ), Input

pen check boxes

350 and 360, time display window 370, and submit an answer window 380.

The examinee may check an answer that is considered to be the correct answer among the answer input fields 320 corresponding to the question number 310 for each question.

Resolve check box 330 is a window that the examinee can check when the examinee enters the answer in the answer field 320 for the question that the examinee is not sure about later. The check box 330 again may be activated to enable the examinee to enter the answer in the answer input box 320.

Later check box 340 is a window that the examinee can check when the examinee does not enter the answer to the answer input box 320 for questions that are not convinced to enter the answer later. Later check box 340 may be activated to enable the check only before the examinee enters the answer in the answer field (320).

The input pen check box may include a plus pen check box 350 and a signature pen check box 360 for a computer, and the user may select one of them. That is, when the user selects the plus pen check box 350, the selection of the computer sign pen check box 360 may be canceled, and when the user selects the computer check pen check box 360, the selection of the plus pen check box 350 may be cancelled.

When the plus pen check box 350 is selected, when the examinee inputs an answer in the answer input box 320, the selected answer may be displayed in red. On the other hand, when the computer sign pen check box 360 is selected, when the examinee enters the answer in the answer input field 320, the selected answer may be displayed in black.

Answers marked in red may not be accepted as actual answers chosen by the examinee when scoring. In contrast, answers marked in black may be accepted as actual answers chosen by the examinee when scoring. Candidates can mark their answers with a black (signal for computer) basically, and mark an example with a red (plus pen) in addition to a black-marked answer. On the other hand, it is also possible to activate the check box 330 to be able to input only when the examinee checks the answer input box 320 in red.

Alternatively, the input pen check box may include a pencil check box and a signature pen check box for a computer, and a user may select one of them. When the pencil check box is selected, the answer entered by the examinee in the answer input box 320 may be displayed differently from the answer entered by the examinee in the answer 320 when the computer check pen check box is selected. For example, when the computer check pen check box is selected, the answer may be displayed darker than when the pencil check box is selected.

Both the pencil-marked answer and the computer-signed answer can be taken as the actual answer chosen by the examinee. However, if the answer is displayed with a computer sign pen, the answer may not be corrected, but if it is marked with a pencil, the answer may be set to be correctable.

Alternatively, the input pen check box may include a plus pen check box and a pencil check box.

The above-mentioned plus pen check box, computer sign pen check box, and pencil check box are just examples, and other types of input methods may be provided.

The time display window 370 may display the total exam time, the elapsed time, the remaining time, and the like. The time display window 370 may display the entire examination time, the elapsed time, the remaining time, or the like as a graphic or text.

The Submit Answer button 380 is a button that the examinee presses when the examinee submits an answer after completing the test. In one example, the Submit Answer button 380 may be activated after the answers are checked in black for all questions. Alternatively, if the submit an answer button 380 is pressed while the answer is not checked in black for all questions, a window for confirming again whether to submit the answer may be generated.

In another example, when the examinee presses the test taking button 240, the display unit 130 may be switched to the test paper screen 400. Referring to FIG. 4, the test paper screen 400 includes an item 410, an answer 420 for each item, a check box 430 for each item, input

pen check boxes

450 and 460, and a time display window 470. ), And a submit an answer window 480.

The examinee can read the question and the answer to the question and select the answer that he thinks is the correct answer. In order to distinguish between the different answers and the answers chosen by the examinee, the answers chosen by the examinee may be displayed differently. For example, in FIG. 3, a check mark may be displayed on the number of answers selected by the examinee.

The check box 430 may be entered by the examinee when the examinee enters an answer for a question that he or she is unsure of, and may be checked by the examinee when he or she wants to review it later, or the answer may be entered later after the examinee does not enter the answer. This is a window that the examinee can check.

Although one check box 430 is shown in FIG. 3, the Unsolve check box that is used when the user wants to review the answer after entering the answer, and the Unsolve Later check box that is used when the user wants to enter the answer later without entering the answer. Likewise, it is also possible for more than one check box to be used for a particular purpose. In one example, the Uncheck Again check box may be enabled to check only after the examinee has selected an answer, and the Unsolve Check later box may be enabled to check only before the examinee has selected an answer.

The input pen check box may include a plus pen check box 450 and a signature pen check box 460 for the computer, and the user may select one of them. That is, when the user selects the plus pen check box 450, the selection of the computer sign pen check box 460 may be canceled, and when the user selects the computer sign pen check box 460, the selection of the plus pen check box 450 may be released.

If the plus pen check box 450 is selected, the selected answer may be checked in red when the examinee selects the answer. On the other hand, if the computer sign pen check box 460 is selected, the selected answer may be checked in black when the examinee selects the answer.

Answers checked in red may not be accepted as actual answers chosen by the examinee when scoring. In contrast, the answers checked in black may be recognized as the actual answers chosen by the examinee when scoring. The examinee can check the answer with a black (signal for computer) basically, and check the answer for choosing the answer in red (plus pen) in addition to the answer checked in black. On the other hand, the re-release check box 330 may be activated to be input only when the examinee checks in red.

The time display window 470 may display the total exam time, the elapsed time, the remaining time, and the like. The time display window 470 may display the entire examination time, the elapsed time, the remaining time, etc. graphically or by text.

The Submit Answer button 480 is a button that the examinee presses when the examinee submits an answer after completing the test. In one example, the submit an answer button 480 may be activated after the answers are checked in black for all questions. Alternatively, if the answer button 480 is pressed while the answer is not checked in black for all questions, a window may be generated to confirm again whether or not to submit the answer.

In another example, when the examinee presses the test taking button 240, the display unit 130 may simultaneously display the answer sheet screen 300 and the test sheet screen 400. Alternatively, the display unit 130 displays one of the answer sheet screen 300 and the test sheet screen 400 according to the examinee's selection, and the answer sheet screen 300 and the test sheet screen 400 may be switched to each other according to the examinee's instructions. have.

In this example, when the examinee checks the answer field 320 of the answer sheet screen 300, the corresponding answer 420 of the test sheet screen 400 is checked, or when selecting the answer 420 of the test sheet screen 400 It is also possible that the answer sheet 320 of the answer sheet screen 300 is checked.

Referring back to FIG. 2, the controller 140 may generate the examinee test information based on the information input by the examinee through the input unit 120. Examination information for the examinee includes information on the answers entered by the examinee, information on the time required by the examinee for each question, information on the total time spent by the examinee on all questions, and the examinee's answers to the questions. It may include information about the order of inputting, information on whether to input again to solve the uncertain questions or to solve later.

4 is a view for explaining an example of a method for measuring the time required for each item.

In the example of Figure 4, the examinee enters the answers in the order of three questions, four questions, two questions after the start of the test. In this case, the time taken by the examinee for the first question (item 3) may be the time from the test start time to the time when the answer of the corresponding question (item 3) is entered. On the other hand, the time taken for the first unanswered question (e.g., item 4) is the time required for the answer of the previous question (item 3) to the time for entering the answer for the question (item 4). It can be time.

5 is a view for explaining another example of a method for measuring the time required for each item.

5 illustrates a method of measuring the time required for each item when the examinee inputs the solve again or solves later. In the example of FIG. 5, the examinee enters the answer of item 4 following the question 3 and then checks the answer of item 4 because it is uncertain. After that, the examinee re-enters the answer of item 4 and the question 4 again. In this case, the time required for question 4 is the time from the time of entering the answer of the previous question (item 3) to the time of checking the resolving of the question (item 4), and the previous question (item 50). It can be the sum of the time from the time you entered your answer to the time you entered the answer to your question (item 4).

Also, if you check Unlock later, similarly to the Unlock again, the time required for the question is the time from the time you entered the answer to the previous question to the time you checked for the later unsolved question, and the answer to the previous question. It may be the sum of the time from the time you enter the time to the time you entered the answer to the question.

On the other hand, the time required for the item solved after solving the question solved again or solved later may be calculated based on the time of solving the problem solved again or solved later.

In addition, the examinee test information may include information about the total time taken by the examinee for the entire question. The total time required may be the time from the start of the test until the Submit Answer button 380 is pressed. Alternatively, the total time required may be the sum of time required for each item.

In addition, the examinee test information may include information about the order in which the examinee entered the answers to the questions.

In addition, the examinee's test information may include information on whether each item has been solved again or later solved in order to check an uncertain question.

In addition, the examinee test information may include information about the answers marked in red in addition to the answers marked in black.

The examinee test information described above may be transmitted to the test management server 20 by the communication unit 110 when the examinee presses the button for submitting

answers

380 and 480.

6 and 7 are diagrams illustrating data transmitted from the examinee terminal to the test management server including the examinee test information.

In the example of FIG. 6, the data may include information of total time required and information in order of problem solving. The data may include information on marking answers for each question, information on whether to solve or resolve later, information on time to solve a problem, and information on whether or not to change the answer. In the example of FIG. 6, the examinee test information may be transmitted in a form arranged by the controller 140 of the examinee terminal 10.

In the example of FIG. 7, the data may include the examinee's input over time. The data may be a sort of all the input behaviors of the examinee over time. In the example of FIG. 7, the organized form of examinee test information will be extracted at the test management server.

8 is a block diagram illustrating a configuration of a test management server 800 according to an exemplary embodiment.

Referring to FIG. 8, the test management server 800 includes a communication unit 810, a problem database 820, and a grader 830.

The communication unit 810 is a configuration for communicating with the examinee terminal through a network. In addition, the communication unit 810 may be used to communicate with the instructor terminal to be described later.

The problem DB 820 includes data about a problem of a test performed by the examinee and data about a correct answer thereof.

Depending on the type of test performed by the examinee, test sheet setting information or answer sheet setting information may be generated based on data (eg, the number of questions, the number of answers, etc.) stored in the problem DB 820. The test sheet setting information or answer sheet setting information may be transmitted to the examinee terminal through the communication unit 810.

The grader 830 may grade the examinee's answer based on the information about the correct answer of the test performed by the examinee.

In addition, the problem DB 820 may include information about attributes of each item. The item attribute information may include the difficulty level of the item (eg, upper, middle, and lower), the type of the item (eg, understanding, application, deepening, etc.), unit information, and the like. The information in a unit can be organized hierarchically into large, medium, and small categories. This item attribute information can be used to analyze and consult the examinee's test results.

The grader 830 scores the examinee's answer using the examinee's test information received from the examinee's terminal.

In addition, the grader 830 may perform analysis and statistics based on the examinee test information, and provide analysis statistical information. In more detail, the grader 830 may provide the examinee's problem solving habit-related information and grade-related information. For example, analysis statistical information provided by the grader 830 may be as shown in Table 1 below.

Table 1

Problem Solving Pattern Information	Sexual Information
-Time measurement function-Solve order-Uncertain question precheck function	-Result score-Correct / incorrect item by item-Answer item number collection-Worried item number collection-Vulnerable unit-Pattern comparison by item

The time measurement function can be used to determine whether the examinee effectively manages the test time.

The solution order, together with the item attribute information, can be used to determine the examinee's test habits. For example, it can be used to determine whether the order of solving correlates to item scoring, difficulty, type, unit, or the like.

Uncertain item prechecks can be used to determine whether an examinee conducts a careful examination while pre-checking uncertain items.

The result score represents the test score of the examinee.

The correct / incorrect answer for each question indicates whether the examinee selected the correct or incorrect answer for each question.

A collection of incorrect question numbers provides the examinee with the wrong questions.

The collection of question numbers that the examinee presents to the candidate selected during the solving process by marking the question again for unsure or later solving. Regardless of the correct or incorrect answer, the examinee was not convinced that the question could be provided as information.

Vulnerable units may have a unit name corresponding to an incorrectly answered question, or a unit name corresponding to a question that is concerned. In addition to vulnerable units, it is also possible to provide vulnerable types in which the type corresponding to the incorrectly answered or worried question (eg understanding, application, deepening, etc.) is indicated.

For each item, the pattern comparison can be provided by analyzing the pattern information of all students who took the test. For example, the item-by-item pattern comparison may be as Table 2 below.

TABLE 2

Pattern comparison by item
-Answer selected by examinee-Actual correct answer-Correct / incorrect-Overall correct rate-Correct rate of upper examinees	-Time for problem solving for examinees-Average time for problem solving for all examinees-Whether the examinee chooses to solve / resolve later-Percentage of retakes / solve for all examinees

The above-described analysis statistical information may be provided to the instructor terminal for use when the instructor consults with the examinee, or the examinee may be provided to the examinee terminal to check his problem solving habit. Details of the analysis statistical information provided to the instructor terminal and the examinee terminal may be different.

9 and 10 are diagrams illustrating the pool pattern inquiry screen displayed on the instructor terminal.

Referring to FIG. 9, the problem pattern inquiry screen includes a sequence of problem solving, whether the examinee's noon answer is correct for each question, the overall correct answer rate, the examinee's problem solving time, the average examinee's problem solving time, and the top examinee's (for example, the parent's problem). 1% examinee) problem pool may include information such as average time, cumulative time, remaining time, difficulty, type, scoring, unit.

Referring to FIG. 10, the solution pattern inquiry screen may provide a number of questions, a score, and a time for a problem solved, a problem solved, an obscure problem, and the like. An ambiguous problem may correspond to the number of questions the examinee has marked for re-ease or later solved. Or, an ambiguous problem may correspond to the number of questions for which the candidate's answers have been changed.

11 is a diagram illustrating a detailed pattern analysis screen for each item displayed in the instructor terminal.

Referring to FIG. 11, the detailed pattern analysis screen for each question shows the answer selected by the examinee, the actual correct answer, whether the answer is correct or incorrect, the percentage of correct answers of the examinee, the time of problem solving by the examinee, the average time of problem solving by the examinee, the solving of the problem, or the solving later It may include whether it is marked, the percentage of examinees who have unwound again or later unwound among all examinees, whether or not it has been marked with a plus pen (red).

10 and 11 show the results of analysis for each examinee.

Alternatively, the information displayed on the instructor terminal is information on all examinees (for example, the number of examinees, the average score of all examinees, the average score of the top examinees, the average solve time of all examinees, the average solve time of the top examinees, etc.) Or analysis information for each item (for example, for each item, the correct answer, the average solution time, the correct answer rate, the selectivity of each answer, etc.) may be displayed.

12 is a flowchart showing a test progress method according to the first embodiment of the present invention.

Referring to FIG. 12, the test management server transmits test sheet setting information or answer sheet setting information to the examinee terminal (S1210). The test sheet setting information or answer sheet setting information may include a test subject, an exam type, the content of an item or the number of questions, the content of an answer, or the number of answers for each item.

The examinee terminal generates and displays a test sheet and / or an OMR answer sheet based on the test sheet setting information or the answer sheet setting information (S1220). In more detail, the examinee terminal generates a test sheet based on the contents of the questions and the contents of the answers, or the examinee terminal generates the answer sheets based on the number of questions and the number of answers for each question. In addition, the examinee terminal may further display a window for checking each item again or later. In addition, the examinee terminal may further display a check pen check box for a computer that can be used to mark an answer in black and a plus pen check box that can be used to mark an example in which the answer was selected in red, in addition to the answer marked in black. . In addition, the examinee terminal may further display a submit an submit button for submitting an answer when the examinee completes input of an answer.

The examinee terminal receives the answer signal input by the examinee (S1230). In addition, the examinee terminal transmits the answer sheet information to the test management server (S1240).

The answer sheet information is added to the candidate's answer information, including information about the order in which the examinee entered the answers, information about the time taken per question, which is the time the examinee used to enter the answer in each question, and the examinee. May include information about whether the user has checked in the Unsolved or Unsolved window to check the question, and whether the examinee marked the answer by selecting the Plus Pen check box. Such information may be provided as data for consultation with the examinee.

The test management server receiving the answer sheet information scores and analyzes the examinee's answer sheet (S1250).

The test management server may analyze the examinee's problem solving pattern, such as the time the examinee solved the problem, the order of solving, and the preliminary check of the question.

In addition, the test management server may analyze the unit related to the result score, correct / incorrect answer by question, incorrect or troubled question (item checked again or solved later), incorrect or troubled question.

In addition, the test management server may analyze the pattern comparison for each item for each item. The question-specific pattern comparison can be made by the examinee's chosen answer, the actual correct answer, whether the answer is correct or incorrect, the overall percentage of correct answers, the examinee's time to solve the problem, the average examinee's time to solve the problem, whether the examinee chooses to solve or solve it later, or the whole sample. Or information about the percentage of examinees who later chose to solve.

The scoring and analysis results may be provided to the instructor terminal so that the instructor may use the consultation (S1260). Alternatively, the scoring and analysis results may be provided to the examinee terminal for reference by the examinee.

The above-described analysis statistical information can be applied to the practice problem solving training for the examinees and educational institutions, it is possible to analyze the examination pattern that was not possible with the existing paper test paper or paper OMR answer sheet. The results of this analysis can be used as useful information for educational instructors to identify and guide the examinee's problem solving habits.

The analysis statistical information function of the OMR answer sheet can be applied not only to problem solving training such as mock test, but also to general problem collection. For example, problem solving of a paper textbook (problem collection) can be performed by using a terminal which can access a server through a network and display a digital OMR screen.

These digital test papers or digital OMR answer sheets can be used for all types of multiple-choice test training and provide information that has not been identified so far, and can be used by institutions or examinees who provide test-related problem solving services.

The above-described embodiment proposes to provide an OMR answer sheet or a digital test sheet from the test management server 20 of FIG. 1 to the examinee terminal 10. Meanwhile, in the following second embodiment, the examinee terminal 10 may proceed with the test without the OMR answer sheet provided by the test management server 20. In this case, the progress of the test is described below.

Referring to FIG. 13, the examination information input screen 1300 may include a test name input box 1310, a name input field 1320, a gender input field 1330, a grade input field 1340, a school input field 1350, and a school input field 1360. , And confirmation button 1370.

The exam name entry 1310 is used to enter the exam the candidate is currently taking. The candidate may select one of a plurality of tests previously set in the test name input box 1310 or the candidate may directly input the test.

In one example, the answer sheet may be set by a test name entered in the test name input box 1310.

For example, as shown in Table 3 below, when the test type and area / subject are entered in the test name input box 1310, the number of items, the item composition, the test time, and the preliminary marking may be determined.

TABLE 3

Test Type	Area / subject	The number of questions	Item composition	Exam time	Preliminary Marking
Examination for SAT and Academic Evaluation	Korean (Type A / B)	45	Multiple choice	80 minutes	pencil
	Mathematics (Type A / B)	30	Multiple choice 21 questions (No. 1 ~ 21) + Short answer 9 questions (No. 22 ~ 30)	100 minutes	pencil
	English (Type A / B)	50	Multiple choice	70 minutes	pencil
	Social Studies / Science	20	Multiple choice	30 minutes	pencil

For example, when the examinee selects a mock test and a math subject in the test name input box 1310, an OMR answer sheet for 21 multiple-choice questions and 9 short-answer questions may be generated and displayed. At this time, the test time is given as 100 minutes, the preliminary marking before the final marking may be implemented in pencil.

Alternatively, the examinee may directly input at least one of information such as the number of questions, item composition, test time, and preliminary marking.

Referring back to FIG. 13, the name input box 1320, the gender input box 1330, the grade input box 1340, the school input box 1350, the school input box 1360, and the like are used to input candidate information. The candidate may select one of a plurality of settings in the name field 1320, gender field 1330, grade field 1340, school field 1350, and school field 1360, or the candidate may directly enter the field.

The candidate may press the confirmation button 1370 when the input of the gaze information input screen 1300 is completed. Thereafter, the candidate may proceed with the test using the OMR answer sheet displayed on the examinee terminal.

14 is a diagram illustrating an OMR answer sheet displayed on the examinee terminal.

Referring to FIG. 14, the OMR answer sheet is a test information display window 1410, a time display window 1420, an input pen check box 1430, an item number 1440, an answer entry field 1450 for each question, and a cancel response button 1460. ), A pause button 1470 and submit an answer button 1480.

The test information display window 1410 may display information input to the test name input box 1310 in FIG. 13.

The time display window 1420 may display a total examination time, an elapsed time, a remaining time, and the like.

The input pen check box 1430 may be used to select a marking at the time of finally submitting an answer (eg, a computer pen), a preliminary marking (eg, a red plus pen or pencil), or an eraser to erase the entered marking. Can be provided for.

The examinee may check an answer that is considered a correct answer among the answer input fields 1450 corresponding to the question number 1440 for each question.

The test cancellation button 1470 is a button which the examinee presses when canceling the test, and the pause button 1480 is a button which the examinee presses when pausing the test.

The Submit Answer Button 1480 is a button that the examinee presses when the examinee submits an answer after completing the exam.

When the examinee completes the answer input and presses the submit answer button 1480 to submit the answer, the test result screen may be displayed on the examinee terminal.

15 is a diagram illustrating a gaze result screen displayed on the examinee terminal.

Referring to FIG. 15, the test result screen 1500 may include a test information display window 1510, a test result information display window 1520, a question display pattern display window 1530, a later scoring button 1540, and a scoring button 1550. It includes.

The test information display window 1510 may display information input to the test name input box 1310 in FIG. 13.

The test result information display window 1520 may display the allowed examination time, the examination time when the examinee actually took the test, the entire questions and the items actually marked by the examinee, and the average time per question.

The item display window 1530 for each item may display an answer input by the examinee and the time required for each item for each item. The time required for each item may be calculated as described above with reference to FIGS. 4 and 5.

The later scoring button 1540 is a button for later scoring.

A scoring button 1550 is a button for the examinee to grade an answer. When the examinee presses the scoring button 1550, a scoring screen may be displayed on the examinee terminal.

Alternatively, the scoring button may be located on the OMR answer sheet of FIG. 14. In this case, the examinee may proceed with scoring immediately after submitting the answer, and the screening result screen of FIG. 15 may be omitted. Alternatively, a screen in which the gaze result screen of FIG. 15 and a scoring screen to be described later may be combined may be displayed.

16 is a diagram illustrating a scoring screen displayed on the examinee terminal.

Referring to FIG. 16, the scoring screen 1600 may include a test information display window 1610, an item number 1620, a marking answer 1630, a correct answer 1640, a score setting window 1650, and a scoring completion button 1660. It may include.

The test information display window 1610 may display information input to the test name input box 1310 in FIG. 13.

For each question number 1620, the answer entered by the examinee in the OMR answer sheet of FIG. 14 may be displayed as a marking answer 1630. In addition, the examinee may directly input the correct answer 1640 of the test. When the marking answer 1630 and the correct answer 1640 match, the marking answer 1630 is determined to be correct, and when the marking answer 1630 is determined to be incorrect.

The distribution point setting window 1650 may be positioned to set a distribution point for each item. The examinee who scores may set a scoring point corresponding to the scoring setting window 1650.

The scoring completion button 1660 may be pressed when the examinee completes scoring. The scoring completion button 1660 may be set to be activated when the examinee has scored all the questions.

When the scoring completion button 1660 is pressed, the total score is calculated based on whether the marking answer 1630 and the correct answer 1640 match each other and the scoring 1650 in each question, and the examinee can check the calculated total score.

In addition, when the scoring is completed, the examinee's test information may be transmitted from the examinee terminal 10 to the test management server 20. The information transmitted to the test management server 20 may include test information (enter in the test name input box 1310 of FIG. 13), information on the total time required, information on the time required for each question, information on the order of problem solving, and each information. Marking of questions about the answers, information on the correct answers to each question, information about whether the candidate has answered the correct answer for each question, scoring information on each question, and whether the candidate has preliminarily marked each question. Information on whether or not the examinee has modified the marking for each question.

The test management server 20 may perform analysis and statistics based on the information received from the examinee terminal 10 and provide analysis statistical information. In more detail, the test management server 20 may provide the examinee's problem solving pattern information and grade related information. As described above with reference to Table 1, the problem solving pattern information may include a time measurement function, a solution order, an uncertain question precheck function, and the like, and the grade related information may include a result score, correct / incorrect answer for each item, and incorrect item number. This may include vowels, collections of question items, weak units, and item-by-item comparisons.

The test management server 20 may find a plurality of examinees who have taken the same test through the test information, and analyze and provide pattern information of all examinees for the same test. As described above with reference to Table 2, the test management server 20, for each question, the answer selected by the examinee, the actual correct answer, whether it is correct or incorrect, the total percentage of correct answers, the percentage of correct answers of the upper examinees, the problem solving time of the examinee, The problem pool of all examinees can be provided with an average time, whether or not the candidate has preliminary marking, and the preliminary marking rate of all examinees.

The test management server 20 may provide analysis statistical information to the examinee terminal 10 or the lecturer terminal 40.

16 is a flowchart illustrating a test progress method according to a second embodiment of the present invention.

Referring to FIG. 16, the examinee terminal generates and displays an answer sheet based on the information input by the examinee (S1610).

The information input by the examinee may include information about the test and the examinee's information. Based on the information about the test, the number of items, the composition of the items, and the test time can be determined. Alternatively, the information input by the examinee may include information on the number of questions, item composition, test time, and the like. The examinee terminal may also display a window for selecting final marking, preliminary marking, and answer correction. In addition, the examinee terminal may display a button for submitting an answer when the examinee completes input of an answer.

The examinee terminal receives the answer signal input by the examinee (S1720), and receives the information scored by the examinee after the test is completed (S1730). In addition, the examinee terminal transmits the information of the answer input by the examinee and the information scored by the examinee to the test management server (S1740).

The information that the examinee terminal sends to the test management server includes the name of the test, information on the total time required, information on the time required for each question, information on the order of questions solved, information on the marking answers for each question, and the correct answer to each question. Information about the questionnaire, correct / incorrect information for each item, scoring information for each item, information about whether the candidate has preliminarily marked each item, and whether the candidate has modified the marking for each item. can do.

The test management server analyzes the answer based on the information received from the examinee terminal (S1750). The test management server analyzes the examinee's problem-solving patterns such as time measurement, solve order, and uncertain question prechecks. Analyzes can be performed in relation to grades, such as correct / incorrect, incorrect item number collection, trouble item number collection, vulnerable units, and pattern comparison by item. In addition, the test management server may collect information of examinees who have taken the same test and analyze pattern information of all examinees. That is, the test management server may compare the results of the examinees with the entire examinee or the top examinees.

Then, the test management server transmits the scoring and analysis results to the instructor terminal (S1760).

The above analysis statistical information can be applied to the practice problem solving training for the examinees and educational institutions, it is possible to analyze the test take pattern which was not possible in the existing paper OMR answer sheet. The results of this analysis can be used as useful information for educational instructors to identify and guide the examinee's problem solving habits.

These digital OMR answer sheets are available for all types of multiple-choice test training and provide information that has not been identified so far, and can be used by institutions or examinees who provide test-related problem solving services.

The first and second embodiments described above are presented by way of example, and other embodiments in which these are mixed or modified are also possible. For example, the test sheet and / or answer sheet displayed on the examinee terminal is generated based on the setting information received from the test management server as in the first embodiment, and the scoring of the answer is performed at the examinee terminal as in the second embodiment. It is also possible to carry out. Alternatively, the test sheet and / or answer sheet displayed on the examinee terminal may be generated based on the information input by the examinee as in the second embodiment, and the scoring of the answer may be performed by the test management server as in the first embodiment. .

In the above description, all elements constituting the embodiments of the present invention are described as being combined or operating in combination, but the present invention is not necessarily limited to the embodiments. In other words, within the scope of the present invention, all of the components may be selectively operated in combination with one or more. In addition, although all of the components may be implemented in one independent hardware, each or all of the components may be selectively combined to perform some or all functions combined in one or a plurality of hardware. It may be implemented as a computer program having a. Codes and code segments constituting the computer program may be easily inferred by those skilled in the art. Such a computer program may be stored in a computer readable storage medium and read and executed by a computer, thereby implementing embodiments of the present invention. The storage medium of the computer program may include a magnetic recording medium, an optical recording medium, and the like.

In addition, the terms "comprise", "comprise" or "having" described above mean that the corresponding component may be included, unless otherwise stated, and thus excludes other components. It should be construed that it may further include other components instead. All terms, including technical and scientific terms, have the same meanings as commonly understood by one of ordinary skill in the art unless otherwise defined. Terms used generally, such as terms defined in a dictionary, should be interpreted to coincide with the contextual meaning of the related art, and shall not be interpreted in an ideal or excessively formal sense unless explicitly defined in the present invention.

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and changes without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

Claims

An input unit for receiving an answer input by the examinee;

An indicator for displaying at least one of an answer sheet generated based on the test sheet and answer sheet setting information, and displaying an answer input by the examinee on at least one of the test sheet and the answer sheet;

A controller for measuring the time required for each item for the examinee to input the answer of each item for each item; And

An examinee terminal, comprising: a communicator configured to transmit examinee test information including information about an answer input by an examinee and information about time required for each question to a test management server.
The method of claim 1,

The time required for each question is the time from the test start time to the time when the answer of the question is entered in the case of the first question, and if the answer is not the first question, the answer of the question from the time when the answer of the previous question is entered. Examinee terminal, characterized in that the time until the input time.
The method of claim 1,

The controller further measures the total time spent for the examinee to enter the answers to all the questions,

The examinee terminal information further comprises the information of the total use time.
The method of claim 1,

The controller further measures the order of questions in which the examinee selects an answer input,

The examinee terminal information further comprises the information of the order of questions selected the answer input.
The method of claim 1,

The test paper or answer sheet includes a re-entry field for checking the examinee to re-enter the answer of the question, or a later-field for checking the candidate to enter the answer of the question later; ,

The examinee test information further comprises whether the re-entry release field or the re-entry release field of the corresponding item is checked.
The method of claim 5,

The time required for each item, the examinee terminal, characterized in that it comprises a time from the time the input of the answer to the previous item to the time to input the re-entry release field or the later release field.
The method of claim 1,

And the controller performs scoring based on a correct answer input by the user or a scoring input by the user.
The method of claim 1,

The examinee terminal setting information or the answer sheet setting information is determined according to the QR code read by the examinee terminal.
A communicator configured to receive information of an answer input by the examinee from the examinee terminal; And

A test scorer that scores and analyzes the score based on the examinee's test information including information on the answer entered by the examinee and the time required for each question taken by the examinee to input the answer of each question server.
The method of claim 9,

The time required for each question is the time from the test start time to the time when the answer of the question is entered in the case of the first question, and if the answer is not the first question, the answer of the question from the time when the answer of the previous question is entered. Test management server, characterized in that the time until the input time.
The method of claim 9,

The examinee test information further comprises a total use time for the examinee to enter the answers of all questions.
The method of claim 9,

And the examinee test information further comprises a question order in which the examinee selects an answer input.
The method of claim 9,

The test paper or answer sheet provided to the examinee's terminal may include a resolving field for checking the examinee to re-enter the answer of the question, or a later solving field for checking the candidate to enter the answer of the question later. Including,

The examinee test information further comprises whether the re-entry release field or the later release field is checked for the item.
The method of claim 13,

The time required for each item includes a time from the time of inputting the answer of the previous item to the time of inputting the re-entry release field or the later release field.
As the test progress method that is executed in the examinee's terminal,

Displaying at least one of a test sheet and an answer sheet;

Receiving an answer input by the examinee and displaying an answer input by the examinee;

Measuring the time required for each item by the examinee for inputting the answer of each item for each item; And

And transmitting the examinee test information including the information of the answer input by the examinee and the time required for each question to each test management server for each question.
The method of claim 15,

The time required for each question is the time from the test start time to the time when the answer of the question is entered in the case of the first question, and if the answer is not the first question, the answer of the question from the time when the answer of the previous question is entered. The test proceeding method of the examinee terminal, characterized in that the time until the input time.
The method of claim 15,

Measuring the total time used by the examinee to enter answers to all questions;

The examinee test information further comprises the information of the total use time of the examinee terminal test proceeding method.
The method of claim 15,

Measuring the order of questions in which the examinee selects an answer input;

The examinee test information further comprises the information of the order of the questions selected the answer input method of the examinee terminal.
The method of claim 15,

The test paper or answer sheet includes a re-entry field for checking the examinee to re-enter the answer of the question, or a later-field for checking the candidate to enter the answer of the question later;

The examinee test information further comprises whether the re-entry release field or the later release field is checked for the corresponding item.
The method of claim 19,

The time required for each item is a test proceeding method of the examinee terminal, characterized in that it comprises a time from the time the input of the answer of the previous item to the time to input the re-entry release field or the later release field.
The method of claim 15,

And performing the scoring based on the correct answer input by the user or the scoring input by the user.
The method of claim 15,

And determining the examination sheet setting information or the answer sheet setting information according to the QR code read by the examinee terminal.
A test analysis method that runs on a test management server.

Receiving information of an answer input by an examinee from the examinee terminal; And

A test management server comprising the step of scoring and analyzing based on the examinee test information including the information of the examinee input information and the time required for each question taken by the examinee to input the answer of each question Test analysis method.
The method of claim 23, wherein

The time required for each question is the time from the test start time to the time when the answer of the question is entered in the case of the first question, and if the answer is not the first question, the answer of the question from the time when the answer of the previous question is entered. The test analysis method of the test management server, characterized in that the time until the input time.
The method of claim 23, wherein

And the examinee test information further includes a total use time for the examinee to input the answers of all the questions.
The method of claim 23, wherein

The examinee test information further comprises a question order in which the examinee selects an answer input.
The method of claim 23, wherein

The test paper or answer sheet provided to the examinee's terminal may include a resolving field for checking the examinee to re-enter the answer of the question, or a later solving field for checking the candidate to enter the answer of the question later. Including,

The examinee test information further comprises whether the re-entry release field or the later release field is checked for the corresponding item.
The method of claim 27,

The time required for each item includes a time from a time for inputting an answer to a previous question to a time for inputting the re-entry release field or a later-entry release field.