TEDS Data Dictionary

The 18 Year Kings Challenge 2D Drawing Test

Contents of this page:

Introduction

This page describes the 2D Drawing test, one of the web activities in the battery of the 18 Year Kings Challenge twin web study. The 2D Drawing test was the second of the ten tests in the battery.

Description

In the web presentation, the 2D Drawing test was introduced to twins as an activity called "The appreciative neighbours ...", with the following text: "Excellent - the ground is solid and the foundation is sturdy! However, it appears that we are not the only ones to appreciate your skills - the building blocks are already going missing and reappearing in the neighbouring villages. It seems we need to put up some guard towers! Will you give the architects some guidance by sketching how the towers should be built?" This text was accompanied by the image below:

Cross-Sections game intro image

The test itself consisted of a practice item followed by 5 scored test items. Each item consisted of a stimulus image and a square grid for drawing a response image. The stimulus image represented a 3-dimensional rectilinear polygon, constructed from simple cuboidal elements whose dimensions in each direction were 1, 2 or 3 units in length (see example image below in the instructions page). Twins were asked to respond by drawing a 2-dimensional rectangular projection of this shape from a specified direction. labelled as "Front" on the stimulus image. Drawing was achieved on the grid by placing lines between pairs of dots; this was accomplished by clicking on the dots. Lines could be drawn vertically, horizontally, and diagonally at 45 degree angles between pairs of dots. Once drawn, a line could be erased by right-clicking.

Each item had a 45 second time limit. When a twin had completed their drawing, if this was done within the time limit, they could proceed to the next item by clicking on a "next" button. However they could not proceed in this way without drawing at least one line on the grid. If the time limit was reached without the next button being clicked, the drawing was submitted whether finished or not, and the next item would be presented. Even if timed out, a drawing would be given credit if at least partly correct. The score for each item was a decimal number between 0 and 1, reflecting the amount of correct drawing completed by the twin. The stimulus images can be found below under the heading Table of Test Items.

The test was preceded by an instructions page, which is reproduced here, and which illustrates the nature of the test items:
2D test instructions

The instructions page was followed by a single practice item. The practice item was optional: a twin could skip the practice item, attempt it once, or attempt it many times if they wished. On each attempt of the practice item, the twin was presented with feedback giving a mark for their response, and showing what the correct response should have been. No such feedback was given after the main test items. No data for the practice item is included in the dataset.

The 5 main test items followed immediately after the practice item. The items were presented in numerical item number order, without any branching or discontinue rules. Each item had a 45 second time limit, and a count-down timer was shown at the top-left corner of the page for every item, as a reminder of this.

Twins were encouraged to complete the test in one session if possible. Hence, no "come back later" button was placed on screen at any stage. However, it was possible to halt a test, by closing the browser or turning off the computer. After halting the test, it was possible for a twin to resume at a later time or date by logging in again: they would be presented with the next item to be attempted.

An individual test item could be compromised by an interruption after the item had started and before it had ended. Interruptions might result from twin actions such as closing the browser, or clicking the browser's back or refresh buttons. Interruptions might also be caused by random events such as computer crash or loss of internet connection. Such events seem to have been rare. The effect of interruption was to forfeit the item with zero score. On logging in at a later time after an interrupted item, a twin would be presented with the following item of the test.

Web Test Rules

  • Scoring
    For each of the 5 items, a decimal score between 0 and 1 is given. A score of 1 is given for a completely correct response; a score less than 1 but greater than 0 is given for a response with some correct lines deserving of credit; a score of 0 is given for a response with no correct lines, or with insufficient correct lines to gain any credit. The practice item does not contribute to the scoring. The maximum total score for the test is 5. The algorithm for scoring partly-correct responses, with scores between 0 and 1, is not available here.
  • Timeout rule
    A timeout of 45 seconds applies to each item. After 45 seconds, if the twin has not yet clicked on the "next" button, any drawing completed by the twin is submitted to the web server and given a mark; the message "Time is up. Press Next to continue" appears on the screen, and the twin is prevented from drawing further lines. It was possible to pause indefinitely at this stage before continuing with the next item in the test.

Dataset Item Variables

The item variables relating to this test, as listed in the table below, were generated automatically by programs on the web server. For the sake of completeness, the table also lists derived variables relating directly to this test (rck2ddata1/2, rck2dstat1/2, rck2dtime1/2, rck2dtmn1/2, rck2dXan1/2). Note that the dataset only includes data for completed tests. If a twin started the test but left it unfinished, then the data for that test were deleted from the dataset.

The raw item response variables contained complex strings representing the set of lines drawn on screen. In the dataset, these have been replaced by much simpler categorised item response variables as shown in the table.

Note that the item response variables have also been recoded where appropriate with values -1 or -4 to denote item timeout (without response) or interrupted respectively. Each valid response, originally a long and complex string, has been recoded to an integer representing simply the number of lines drawn in the response. See the web data cleaning page for further details. The start and end dates/times have not been retained in the dataset.

VariablesExplanationValues
rck2ddata1/2 Data flag: are test data present? [DERIVED VARIABLE] 0=no, 1=yes
rck2dstat1/2 Test status: was the test completed? [DERIVED VARIABLE] 0=not started, 1=started but not finished, 2=finished successfully, 3=compromised by loss of data, 4=compromised by random responses
rck2dsttm1/2 Start date and time of the test [not in dataset] Date-time values
rck2dentm1/2 End date and time of the test [not in dataset] Date-time values
rck2dtime1/2 Time interval from start to end of the test [DERIVED VARIABLE] Minutes (decimal values)
rck2dtmn1/2 Mean item response time [DERIVED VARIABLE] Seconds (decimal values)
rck2dXan1/2 Test item response category for item X* [DERIVED VARIABLE] 1, 2, 3, etc=number of lines drawn in response,
-1=exceeded time limit with zero score (effectively timed out),
-4=item interrupted
rck2dXsc1/2 Test item score for item X* 0 to 1 (decimal values)
rck2dXrt1/2 Test item response time for item X* Milliseconds (integer values)
rck2dtot1/2 Test total score: total score for all 5 items 0 to 5 (decimal values)
rck2dtotp1/2 Test total score expressed as a percentage 0 to 100 (decimal values)

* X denotes the item number, 1 to 5

Table of Test Items

The practice item and 5 main test items are tabulated below, in each case showing the stimulus image and an image of a fully correct answer (with maximum item score 1).

Practice item stimulus:
practice item stimulus image
Practice item correct response:
practice item correct response
Item 1 stimulus:
item 1 stimulus image
Item 1 correct response scoring 1:
item 1 correct response
Item 2 stimulus:
item 2 stimulus image
Item 2 correct response scoring 1:
item 2 correct response
Item 3 stimulus:
item 3 stimulus image
Item 3 correct response scoring 1:
item 3 correct response
Item 4 stimulus:
item 4 stimulus image
Item 4 correct response scoring 1:
item 4 correct response
Item 5 stimulus:
item 5 stimulus image
Item 5 correct response scoring 1:
item 5 correct response