Creating, reviewing and accepting a Custom or Adaptive test

Print Friendly

A: Test Details

1. Select ‘Create New Test' from left menu

Image: Test Details

2. Click ‘Create Customised Test' or ‘Create Adaptive Test'

3. Enter a Test Name of up to 20 characters.

  • Be specific! Naming conventions make it much easier to find the test later. Students will see this name when they sit the test.

4. If you would like, enter a Description.

    • This is helpful in telling tests apart which may be useful for other teachers in your school. Tick the check-box if students should see the description.

5. Use the drop-down to select the Subject.

6. Enter a number into Test Duration.

  • This is the time available for sitting test questions. Check the table on the screen to see the test durations available for your test type, and how the duration you choose affects the number of curriculum areas you may include in the test.

7. Click ‘Continue'.

 

B: Curriculum Levels

Image: Curriculum Levels Sliders

1. Drag the blue slider to show how much of that curriculum level you would like in the test. (For Adaptive tests you can select Yes/No only).

  • You can select up to three adjacent levels. It is a good idea to always move at least one slider to “Most”.
  • For guidance on level selections, see Guidelines on creating a good test.

2. Click ‘Continue'.

 

C: Curriculum Strands

1. Read the message on the screen carefully. It tells you how many strands you can choose, based on your subject and test duration.

Image: Curriculum Strands Sliders

2. Drag the blue slider to show how much of each curriculum strand you would like in the test.

  • Remember to always move one slider to “Most”!

3. Click ‘Continue'.

Curriculum strands aggregate together achievement objectives derived from the 2007 Curriculum documents. Click here to see the e-asTTle curriculum maps.

 

 D: Attitude and Delivery

1. Custom tests only: Select a radio-button to choose how your test will be administered.Image: Attitude and Delivery

  • Choose carefully! Some questions (e.g., drawing questions) only come up in paper tests. This means if you change delivery method while reviewing the test, your test be re-created from scratch and have a new set of questions. Your delivery method cannot be changed once your test has been accepted.

2. If you have chosen ‘Onscreen’, you must use the drop-downs to choose:

Look-over time (preview): maximum time students may pre-read the test without answering.

Time for Attitude Questions: maximum time students may spend answering attitude questions.

  • The screen will add up the Total Test Time. When booking computer labs, allow extra time on top of this for logging in, resetting lost passwords and going through the practice questions.

3. Drag the blue slider to indicate your preferred proportion of Closed Questions.

  • Closed questions have a fixed correct answer, e.g., multi-choice. They can be computer marked.

4. Use the drop-down to select from the available Attitude Domains. See Attitude Question Details for Maths, Reading and Writing to see the question lists and decide which are most appropriate for your students’ age and reading level.

  • Currently, only the general attitude set is available for Māori Medium subjects.

5. Click ‘Continue'.

E: Review and Create Test

1. Check through the summary of choices you made for the test.

2. If needed, go back and adjust settings by clicking the link next to the step number.

3. Click ‘Create Test'

It will usually take a few minutes to process your test. You have two options:

1. Stay on the page and wait for the ‘Test Ready' link

2. Navigate away to other e-asTTle screens or elsewhere. Look for your test on the View Existing Test screen later.

 

 F: Evaluate and Accept Test

Once your test is created, it will say ‘Pending’ next to the test name. You need to view the test and use your professional judgement to evaluate the test summary and test questions.  If no further changes are required, click the ‘Accept' button. After your test has been accepted it will become available for you to assign.

Test creation is not a perfect process:
e-asTTle test creation balances many complicated factors – such as your choices, reading times, the mix of deep and surface questions. This means it sometimes returns questions in strands or levels you didn’t specify. Always check the actual numbers of questions returned in each category, and gauge if the test is sufficiently close to what you asked for.

Reviewing the test

What to look at first:

1. Before you look at the test questions, look at Section 2 (Curriculum Level) and Section 3 (Curriculum Strands). Compare ‘Selected’ with the ‘Actual’ numbers.

• Are there questions in every sub-level (B=Basic, P=Proficient, A=Advanced) within the levels you asked for?

• Are there enough questions in your selected strands? 6 or more is a good guideline.

If the test is too different from what you asked for, click on ‘Edit Test Settings'. This will guide you through test creation a second time. You have several options:

• Navigate through and click the ‘Create test’ button again – without changing any settings. You may get a test with fewer gaps on the second attempt.

• Click the ‘Test Details’ button and increase the test duration. Longer tests give e-asTTle more flexibility – for example, it can include longer Reading passages.

• If the created test continues to be very different from your specifications, it may be necessary to compromise by editing some of your strand selections.

Once the Test Summary is OK:

2. Click ‘View Test’. This will bring up the test either as a PDF or a Onscreen Test player.

Test not coming up?
Are your pop-ups enabled?

3. Look at the questions. Overall, does the test look at the right difficulty?

Sometimes, your test might contain a few questions that aren’t quite right. For example, there could be text that’s not age-appropriate, or questions where the concept hasn’t been taught yet. You can replace these using the Replace Questions function. You can swap up to 20% of questions in a Maths test, one passage and its questions for a short Reading test, or two passages and associated questions for a test over 30 minutes long.

4. If the test questions are OK, close the test and then click ‘Accept Test'. Otherwise, click ‘Edit Test Settings' and change some of your selections. Then, create the test again and re-evaluate.