Using Imagine Galileo's Test Builder Automated Scoring Key

Educators can use Imagine Galileo to create an Automated Scoring Key. Imagine Galileo’s Automated Scoring Key (ASK) allows you to place pre-existing assessment (PDF file format only) content into Imagine Galileo. Creating an answer key in Imagine Galileo aligns each test item to a standard. The tests can be administered online or offline and all data collected from administering tests can be reported through the Imagine Galileo reporting engine.

An automated scoring key assessment can include as many as 120 test items, including up to five open-response test items.

Creating a test with the Automated Scoring Key

Creating a test with the Automated Scoring Key is a three-part process. Click each part below to expand the steps.

Part 1: Set up the test shell

First, you will create the basic shell for your test by defining its core properties.

  1. Log in to Imagine Galileo.
  2. In the top navigation ribbon, hover your cursor over Assessment, then Test Construction, and select Automated Scoring Key.
    galileo_launchpad_select-ASK.png
  3. In the TEST tab, select a library in the Library drop-down list.
    galileo_ask_select-library.png
  4. Enter a test Title.
    galileo_ask_enter-test-title.png
  5. Select a Grade Level and Content Subject using the drop-down lists.
    galileo_ask_select-grade-subject.png
  6. (Optional) Click Choose File and attach a PDF version of the test to use as a test booklet.
    galileo_ask_choose-file.png
  7. Click Save.
    galileo_ask_save-new-test.png
Part 2: Define the answer key

Now that you have created the test shell, you will generate the items (questions) and create the answer key.

  1. Click the ITEMS tab.
  2. Use the drop-down lists to determine how many and what type of items (questions) to include.
    • Choose the number of items to add to the test.
    • Select the number of multiple-choice options for each item.
    • (Optional) Choose the number of Open Response items.
    • Select the subject from which to choose the standards.
    items_tab_Galileo__Automated_Scoring_Key.png
  3. Click Generate Items. A list of items will appear.
    items_tab_ASK_full.png
  4. For each item:
    • Select the correct radio button (A, B, C, D, or E) for each question as it appears on your copy of the test (multiple-choice test items only). 
    • (Optional) Use the Standard drop-down list to select the applicable standard. Leaving the field blank impacts reports.
      items_tab_ASK_standards.png
    • Assign the maximum points for each test item. You can select the trash bin (items_tab_ASK_trash.png) to remove an individual test item.
      items_tab_ASK_points.png
  5. Click Save Items.

Reordering Items

If you need to change the order of the questions:

  • Click Reorder Items.
    items_tab_ASK_reorder_items.png
  • Highlight the applicable item to move and click the up and down arrows.
  • Click Save Changes.
    galileo_ask_rearrange-save-changes.png
  • Click Go Back to ASK Builder to return to the Items tab. 
    galileo_ask_rearrange-go-back.png
Part 3: Publish the test

The final step is to publish the test, which makes it available for scheduling.

  1. Click the Publish Test tab.
    publish_test_tab_ASK.png
  2. Select one of the following statuses:
    • Construction Phase: The default status. The test can be edited but cannot be scheduled.
    • Tryout: The test can be scheduled for practice, but no data is saved to reports. Edits are still permitted.
    • Publish: The test is finalized and can be scheduled for students. It can no longer be edited.
  3. Click Save.

Editing an existing test

 Note

You can edit any test that is in the Construction Phase or Tryout status. Published tests cannot be modified.

To edit an existing test:

  1. In the top navigation ribbon, hover your cursor over Assessment, then Test Construction, and select Automated Scoring Key.
    galileo_launchpad_select-ASK.png
  2. Select the Edit existing test radio button.
    test_tab_ASK_edit_exist_test.png
  3. Use the Library and Test drop-down lists to select the test you wish to edit.
  4. Once the test is loaded, click the tab that corresponds to the part of the test you need to modify:
    • Test Tab: Modify the Title, Grade Level, Content Subject, or change the attached PDF file.
    • Items Tab: Delete items, adjust point values, change correct answers, update Standards, or Reorder Items.
    • Publish Test Tab: Change the test's status (e.g., from Tryout back to Construction Phase).
  5. Click Save in the respective tab after making your changes.

Next steps

Once your test is created and published, you are ready to schedule it for students and view their performance data.

Scheduling the Test

You must schedule a published test before it can be administered to students.

Online vs. Offline Testing

The Automated Scoring Key workflow supports both online and offline test administration.

  • For offline testing, you must print test booklets and bubble sheets for your students. Data will be available after the bubble sheets are scanned.
  • For online testing, students access the test via the K-12 Student-Parent Center. You have the option to attach a PDF of the test for students to view during the assessment. Data is available as soon as students complete the test.
    quest_slide_ASK.png

For detailed instructions on how to schedule your test, create testing sessions, and print materials, please see the articles in the Scheduling Tests section of the Help Center.

Viewing Reports

After students have completed the test, you can analyze their performance.

  1. Navigate to the Teacher Dashboard or the Reports menu.
  2. Select the relevant report to view student data.

Automated Scoring Key tests report raw scores. For online tests, these scores are available immediately. For offline tests, scores appear after the bubble sheets are scanned using Scanline.

 

Articles in this section