TEDS Data Dictionary

The 18 Year Bricks Web Tests

Contents of this page:

Introduction

This page describes the battery of six test activities that were included in the 18 Year Bricks twin web study.

Description

The Bricks tests were designed to test two aspects of spatial ability: mental rotation and visualisation. These aspects were measured separately and together, using both 2D and 3D stimuli, to form a battery of six subtests. The subtests were as listed below, and were presented in the order shown:

Order in batterySubtest namecode description
12D rotation2rThe target object is rotated in the correct response, but is identical in every other respect.
22D rotation/visualisation2rvThe target object is partially obscured by a black 'occluding' shape. The correct response shows the same object, rotated as in the previous variant, while the occluding shape remains unchanged.
32D visualisation2vThe target shows a partially-occluded 2D object. However, the correct response shows the same object in the same position (not rotated); instead, the occluding shape moves to reveal parts of the object which were previously obscured.
43D rotation/visualisation3rvThe object itself rotates (in 3 dimensions) freely between the target and the correct response.
53D rotation3rThe target object remains stationary between the target and the correct response, but the 'camera' (the viewpoint) rotates in 3 dimensions.
63D visualisation3vThe target is a wireframe diagram of a 3 dimensional object, and the correct response is the solid version

Each subtest comprises 12 items (plus some example and practice items). All items, in all 6 subtests, have the same format. Each item presents a target stimulus image and four response images (labelled A, B, C and D in the data). Participants are asked to select the response image which shows the same object as shown in the target. A full table of test items, including all the images used, can be found below under the heading Table of Test Items.

In every case, the target stimulus image appears near the top of the screen (centred horizontally), with the four multiple-choice response images arranged in a single row (also centred horizontally) beneath. In the data, the 4 responses are labelled A, B, C and D, from left to right in the order in which they appeared on screen. All stimuli are presented at a size of 200x200 pixels, surrounded by a thin black border.

At the same time as the images appear, a timer appears on screen (top right) showing '20' in a bold, black font, and begins counting down in seconds, turning red if it reaches 5. Measurement of the participant's reaction time (in milliseconds) starts immediately. If the participant clicks on one of the response stimuli before the timer runs out, measurement of their reaction time stops, the border of the clicked image turns green for 500ms, then all stimuli fade away (over 250ms). After a pause of 500ms, the stimuli for the next item fade into view (over 250ms) and the timer begins counting (from 20) once this latter fade is complete. If the timer reaches 0 before the participant makes a response, responses are disabled, all stimuli are faded to a light grey (opacity 0.3), and a 'Next' button appears at the bottom of the screen alongside the message (in red) 'Out of time. Press Next to continue'. Clicking on this button triggers the same fade/replace behaviour described above.

Each subtest started with an explanation of what to expect, with an example item where the correct answer was given. The example item was followed by two practice items, to be attempted by the twin, after each of which feedback was given with an explanation of the correct answer. The example and practice items did not contribute to the subtest score. However, they are shown below in the table of test items.

Web Test Rules

  • Item order
    The order of the items is fixed, with no branching. The order is shown in the table of test items below.
  • Scoring
    For each item the correct response is given a score of 1, and an incorrect response is given a score of 0. The maximum total score for each subtest is 12 (not including the practice items).
  • Discontinue rule
    This rule operates within each subtest independently. If the participant makes four consecutive incorrect responses, they discontinue, scoring 0 for any remaining items and skipping to the beginning of the next subtest. Timeouts are treated as incorrect responses for this purpose. The discontinue rule does not include the initial practice items.
  • Timeout rule
    A timeout of 20 seconds applies to each item, as described in detail above. After 20 seconds with no response, the item is forfeited with zero score, and a "next" button appears. On resuming the test, the twin is taken to the next item in sequence as described above.

The tests were designed to be completed in one session. Within each subtest all responses were recorded in the browser (using javascript) and only submitted to the web server at the end of the subtest. Hence, if any subtest was halted part-way through, for example by closing the browser, then all responses were lost for that subtest; in this case, a twin would have to re-start the subtest from scratch on logging in again. If a twin attempted to repeat a question, using the browser's Back or Refresh buttons, then a warning message would appear in a pop-up box; if the twin ignored the message, then the test would be halted, and the twin would have to re-start the entire subtest from scratch.

Dataset Item Variables

The item variables relating to the Bricks subtests, as listed in the table below, were generated automatically by programs on the web server, with a few exceptions. The exceptions (subtest score, subtest status, time spent on the subtest, mean item response time in the subtest) were derived during dataset construction, and are included here to complete the set of variables relating directly to Bricks subtests. The raw subtest scores were included as an item in the raw data (originally with values 0-12), but it was decided to re-compute the score from 9 of the 12 items in each subtest.

Note that the dataset only includes data for successfully completed subtests. If a twin started a subtest but left it unfinished, then the data were not submitted to the web server and were therefore not recorded. If the subtest data were found to be compromised, either through loss of data or through random responding, then the subtest item data have been recoded to missing in the dataset. The start and end dates/times have not been retained in the dataset.

Note that the item response variables have been recoded where appropriate with values -1, -2 and -4 to denote item timeout, discontinued or malfunctioned respectively. See the web data cleaning page for further details.

In the table below, XX refers to the subtest code (2r, 2rv, 2v, 3rv, 3r, 3v) and YY refers to the item number (practice items p1 and p2, main items 01 to 12).

VariablesExplanationValues
rcbXXdata1/2 Data flag: are test data present? 0=no, 1=yes
rcbXXstat1/2 Test status: was the test completed? [DERIVED VARIABLE] 0=not started, 2=finished successfully, 3=compromised by loss of data, 4=compromised by random responses
rcbXXtot1/2 Total score for the subtest [DERIVED VARIABLE] 0 to 9 (integer values)
rcbXXsttm1/2 Start date and time of the subtest [not in dataset] Date-time values
rcbXXentm1/2 End date and time of the subtest [not in dataset] Date-time values
rcbXXtime1/2 Time interval from start to end of the subtest[DERIVED VARIABLE] Minutes (decimal values)
rcbXXtmn1/2 Mean item response time [DERIVED VARIABLE] Seconds (decimal values)
rcbXXYYr1/2 Item response 1=A, 2=B, 3=C, 4=D (denoting the image selected),
-1=timed out, -2=discontinued, -4=item malfunctioned
rcbXXYYs1/2 Item score 0=incorrect, 1=correct
rcbXXYYt1/2 Item response time Milliseconds (integer values)

Table of Test Items

The table below lists the test items, showing all the item target and response images from all 6 sub-tests. The images are shown the same size as they appeared in the web test (200 x 200 pixels).

Subtestitemtarget imageresponse A response Bresponse Cresponse Dcorrect response
2D rotation (2r)Introductory text:
This part of the study tests your ability to recognise 2D objects in different orientations. Each question will appear like this example:
[example item images as below]
For each question, please identify which of the four options shows the same object as the one depicted at the top. Only one option is correct in each case, showing the same object, rotated but not flipped over. Each of the other three objects is different. In the example above, the correct answer is A.
example item2r example2r example2r example2r example2r example A
p1 (practice item)2r prac12r prac12r prac12r prac12r prac1 C
p2 (practice item)2r prac22r prac22r prac22r prac22r prac2 D
12r item012r item012r item012r item012r item01 B
22r item022r item022r item022r item022r item02 A
32r item032r item032r item032r item032r item03 C
42r item042r item042r item042r item042r item04 D
52r item052r item052r item052r item052r item05 A
62r item062r item062r item062r item062r item06 C
72r item072r item072r item072r item072r item07 C
82r item082r item082r item082r item082r item08 B
92r item092r item092r item092r item092r item09 D
102r item102r item102r item102r item102r item10 B
112r item112r item112r item112r item112r item11 C
122r item122r item122r item122r item122r item12 A
2D rotation and visualisation (2rv) Introductory text:
This part of the study tests your ability to recognise 2D objects in different orientations, when parts of them are hidden from view. You will have to use the available information about the sizes and shapes of each part of the object, and use this to eliminate the impossible answers. Each question will appear like this example:
[example item images as below]
For each question, please identify which of the four options shows the same object as the one depicted at the top. Only one option is correct in each case, showing the same object, rotated but not flipped over. Each of the other three objects is different. In the example above, the correct answer is A, as this is the only one which could be the same as the target object.
example item2rv example2rv example2rv example2rv example2rv example A
p1 (practice item)2rv prac12rv prac12rv prac12rv prac12rv prac1 A
p2 (practice item)2rv prac22rv prac22rv prac22rv prac22rv prac2 D
12rv item012rv item012rv item012rv item012rv item01 C
22rv item022rv item022rv item022rv item022rv item02 D
32rv item032rv item032rv item032rv item032rv item03 C
42rv item042rv item042rv item042rv item042rv item04 B
52rv item052rv item052rv item052rv item052rv item05 B
62rv item062rv item062rv item062rv item062rv item06 D
72rv item072rv item072rv item072rv item072rv item07 A
82rv item082rv item082rv item082rv item082rv item08 D
92rv item092rv item092rv item092rv item092rv item09 A
102rv item102rv item102rv item102rv item102rv item10 A
112rv item112rv item112rv item112rv item112rv item11 D
122rv item122rv item122rv item122rv item122rv item12 B
2D visualisation (2v)Introductory text:
This part of the study tests your ability to recognise 2D objects in different orientations, when parts of them are hidden. You will have to use the available information about the sizes and shapes of each part of the object, and use this to eliminate the impossible answers. Each question will appear like this example:
[example item images as below]
For each question, please identify which of the four options shows the same object as the one depicted at the top. Only one option is correct in each case, showing the same object in the same orientation (not rotated) - only the occlusion (the black shape hiding part of the object) has moved. Each of the other three objects is different. In the example above, the correct answer is B, as this is the only one which could be the same as the target object.
example item2v example2v example2v example2v example2v example B
p1 (practice item)2v prac12v prac12v prac12v prac12v prac1 A
p2 (practice item)2v prac22v prac22v prac22v prac22v prac2 B
12v item012v item012v item012v item012v item01 B
22v item022v item022v item022v item022v item02 B
32v item032v item032v item032v item032v item03 A
42v item042v item042v item042v item042v item04 D
52v item052v item052v item052v item052v item05 A
62v item062v item062v item062v item062v item06 D
72v item072v item072v item072v item072v item07 C
82v item082v item082v item082v item082v item08 D
92v item092v item092v item092v item092v item09 B
102v item102v item102v item102v item102v item10 A
112v item112v item112v item112v item112v item11 C
122v item122v item122v item122v item122v item12 C
3D rotation and visualisation (3rv) Introductory text:
This part of the study tests your ability to recognise 3D objects in different orientations - in other words, imagine that you have stayed still, but the object has been rotated. Each question will appear like this example:
[example item images as below]
For each question, please identify which of the four options shows the same object as the one depicted at the top. Only one option is correct in each case, showing the same object from a different viewpoint. Each of the other three objects is different. In the example above, the correct answer is B.
example item3rv example3rv example3rv example3rv example3rv example B
p1 (practice item)3rv prac13rv prac13rv prac13rv prac13rv prac1 D
p2 (practice item)3rv prac23rv prac23rv prac23rv prac23rv prac2 B
13rv item013rv item013rv item013rv item013rv item01 D
23rv item023rv item023rv item023rv item023rv item02 B
33rv item033rv item033rv item033rv item033rv item03 A
43rv item043rv item043rv item043rv item043rv item04 C
53rv item053rv item053rv item053rv item053rv item05 A
63rv item063rv item063rv item063rv item063rv item06 A
73rv item073rv item073rv item073rv item073rv item07 C
83rv item083rv item083rv item083rv item083rv item08 C
93rv item093rv item093rv item093rv item093rv item09 B
103rv item103rv item103rv item103rv item103rv item10 D
113rv item113rv item113rv item113rv item113rv item11 D
123rv item123rv item123rv item123rv item123rv item12 A
3D rotation (3r)Introductory text:
This part of the study tests your ability to recognise 3D objects when they stay still, but your viewpoint has rotated on the spot. Each question will appear like this example:
[example item images as below]
For each question, please identify which of the four options shows the same object as the one depicted at the top. Only one option is correct in each case, showing the same viewpoint of the same object, just rotated in place - imagine that you are looking at the object through a camera which can be rotated on the spot. In the example above, the correct answer is D - in this image, the only change is that the camera has rotated in place, so you can see all the same parts of the object which were visible in the original image.
example item3r example3r example3r example3r example3r example D
p1 (practice item)3r prac13r prac13r prac13r prac13r prac1 B
p2 (practice item)3r prac23r prac23r prac23r prac23r prac2 C
13r item013r item013r item013r item013r item01 C
23r item023r item023r item023r item023r item02 D
33r item033r item033r item033r item033r item03 A
43r item043r item043r item043r item043r item04 A
53r item053r item053r item053r item053r item05 B
63r item063r item063r item063r item063r item06 C
73r item073r item073r item073r item073r item07 B
83r item083r item083r item083r item083r item08 C
93r item093r item093r item093r item093r item09 A
103r item103r item103r item103r item103r item10 A
113r item113r item113r item113r item113r item11 A
123r item123r item123r item123r item123r item12 D
3D visualisation (3v)Introductory text:
In this part of the study, you will be asked to look at wireframe drawings of objects, and predict what the solid object will look like (from the same viewpoint). Each question will appear like this example:
[example item images as below]
For each question, please identify which of the four options shows the same object as the one depicted at the top. Only one option is correct in each case, showing the same object in the same orientation - nothing has moved, you are just looking at the 'solid' version of the wireframe drawing. Each of the other three objects is different. In the example above, the correct answer is C, because the studs shown in the wireframe are underneath the object (and therefore hidden, from this viewpoint).
example item3v example3v example3v example3v example3v example C
p1 (practice item)3v prac13v prac13v prac13v prac13v prac1 B
p2 (practice item)3v prac23v prac23v prac23v prac23v prac2 C
13v item013v item013v item013v item013v item01 A
23v item023v item023v item023v item023v item02 C
33v item033v item033v item033v item033v item03 C
43v item043v item043v item043v item043v item04 B
53v item053v item053v item053v item053v item05 A
63v item063v item063v item063v item063v item06 B
73v item073v item073v item073v item073v item07 D
83v item083v item083v item083v item083v item08 D
93v item093v item093v item093v item093v item09 D
103v item103v item103v item103v item103v item10 B
113v item113v item113v item113v item113v item11 A
123v item123v item123v item123v item123v item12 B