Instructor- Manage Questions [EMSTesting]
Manage Questions allows instructors to create or edit custom questions for exams or computer-adaptive tests. Custom questions can be searched for by text or curriculum. Additionally, banned questions can be reviewed, and large quantities of questions can be sent to our team for import.
To locate this page, click on your Instructor role for EMSTesting, then select Manage Questions from the red toolbar.
Contents:
A. Question Types:
There are multiple styles of question types to choose from. You will notice there are more listed than what can currently be created. This is because our Development Team is working on these additional question types. All question types listed in grey are available for creation.
Single Answer: This is a question with a singular answer.
Select All That Apply: This question requires multiple selections for the correct answer.
Sequence: This option has students order a list of options into the correct order.
Fill-In The Blank: This option requires the student to enter the correct answer into the box where the blank space in the question is.
- Note: This option is not currently available for online exams.
Free Form: This allows students to enter an answer as a long-form response.
- Note: This option is not currently available for online exams.
B. Creating a New Question:
1. In your Instructor role for EMSTesting, click the tab Manage Questions.
2. On the top right, click the button New Question.
3. Select Question Type, then click Create at the bottom right of the page. Click the different question types to view examples of the type.
4. Enter the Question Text. Click add image to add a picture to the question if desired.
5. Enter the Answers/Annotation: Select the desired options, then add text to the boxes.
Note: Some sections of this area will vary depending on the selected question type.
- Number of Answers: Slide the dial to increase the number of responses.
- Number of Options: Slide the dial to increase the number of options.
- Answer/ Destination Text: The text that will appear for the answers and/or options.
- Correct Answers: Indicate the correct answer(s) or sequence. This section will include a note explaining how that TEI question type works.
- Annotation: (Optional) A rationale for correct and/or incorrect responses. This is visible only in the post-exam review if the "Student Test Results Detail Level" is set to "Level 4".
6. Select the Properties tab and enter the required and desired information.
- Question Reference ID: (Optional) This is where you can assign an individualized reference identifier to your question. When building your tests, this will allow you to pull that specific question onto a test using the “Pull Questions By Text, Keyword, or ID” option.
- Question Bank: The drop-down will indicate the bank in which the question is in our program. Most users will have only one option.
- School: The drop-down allows active instructors from multiple institutions to select the school to which their question belongs. If you are associated with only one school, you will have only one option.
-
Status: The drop-down lets you change the status of your question.
- Draft: This indicates the question is under development and not yet ready for deployment.
- Approved: This indicates that the question is complete, but not yet ready for deployment on an exam.
- Active: This indicates the question is complete and ready for use.
- Note: Your question must be marked Active to be added to a linear test.
- Pilot: This adds the question to the pilot portion of your students' Computer Adaptive Exams. Allowing you to gather info on how the question performs prior to deploying it in exams.
- Disabled: This deactivates the question.
-
Cut Score: This defaults to 0.9. The drop-down allows you to assign the appropriate cut score for your question.
- Info: If you need help determining the appropriate score for your question, please check out our article What is Cut Score, available here.
-
Bloom Level: This defaults to Remembering (Cognitive). The drop-down allows you to assign the appropriate Bloom level for your question.
- Info: If you need help finding the appropriate level, please refer to our article, "What is Bloom Level?" found here.
- Reading Level: To determine the reading level for your question, click the "[re-calc]" link, and the program will calculate your reading grade level.
- Scenario Question: If you check the box to mark your questions as Scenario Questions when applicable, you will be able to use the "Scenario Based Questions" sort when building your tests.
- CAT Enabled: You can mark your question as CAT Enabled if you would like to build your school's question bank for students to use while practicing with the computer-adaptive tests.
7. Click the Keyword tab, then add any keywords desired. Enter the text for the keyword into the box, then click Add Keyword to add the keyword to the question.
On this tab, you can attach specific words or phrases to your questions to make them easier to locate.
- Example: If you are adding multiple questions to the program for a specific test, you can add a keyword such as the name of the test (e.g., "Airway1" or "Anatomy") to all of those questions. Then, when you are building your test, you can use the “Pull Questions By Text, Keyword, or ID” option with your assigned keyword to pull all of your questions with one search.
8. Click the Curriculum tab and add a curriculum. On this tab, you will cross-reference your question with the topic area(s) it relates to. Questions can be associated with multiple objectives across multiple curricula.
Choose Program Type from the drop-down. Select the Provider Level to determine which students the question is appropriate for. Select the Curriculum. Select the Curriculum Level. Once you have made your selections, be sure to click the Add Curriculum button. You can add additional Curricula as needed.
Note: Your question must have at least one curriculum assigned to it in order to include it in a test at that provider level. It doesn't need to be correct, but something must be added.
9. Information tabs: The statistics, messages, and history tabs all provide information on the question after it has been deployed (active or pilot). This allows you to see how the question is performing and potentially adjust it or its properties as needed.
-
Statistics: This tab will show how this question performs on exams. You can adjust the question's properties as needed based on this information.
-
Messages: This shows any feedback provided for this question during an examination.
-
History: This tab shows when the question has been modified, what was changed, and by whom.
-
Notes: This tab shows any additional notes that were entered for the question prior to saving.
10. Save at the bottom of the page.
The system will ask you if you would like to add any additional notes. Any notes added will show in the Notes tab of the question. Click Save when satisfied.
Once saved, the questions can be added to an exam.
Note: If the question appears yellow in your listing, it means it is a draft or missing required information and cannot be active. Edit the question and address any of the red ! above the save button, which indicates any missing information.
C. Manage Questions Page:
The Manage Questions page lets you create new questions, search for questions, learn about importing large batches of questions, and view questions you've banned. This page defaults to the Text Search tab, with the 10 most recently modified questions displayed below.
Search:
Once you have entered the desired information, click the Search button. If anything matches, it will populate below.
-
Text Search: This searches the instructor-created question for text.
-
Curriculum Search: This allows you to search for instructor-created questions by the curriculum that was added to them in their settings.
Import:
This tab gives information on how our development team can import 50 or more questions into your question bank.
Click Download EMSTesting.com Question Import Template to download the template.
Click the different links for information on the MTO curriculum by provider level.
- Info: For more detailed information on question import, click here.
Banned Questions:
This tab shows all the questions you have banned while creating exams.
Click Unban to add the question back into rotation.