TEDS Data Dictionary

The 12 Year GOAL (Reading Comprehension) Web Test

Contents of this page:

Introduction

This page describes the GOAL test (also called Reading Comprehension) that was included in the 12 Year twin web test battery.

Description of Test

The test consisted of a series of reading comprehension questions. For each question, there were four possible responses; the twin selected a response by clicking on it on the screen. There were 36 items: the questions and responses are tabulated further down this page in the table of items. Any given twin taking the test may have been presented with fewer than 36 items, because of the branching and discontinue rules, which are described under the next heading.

Each item is matched to a level (2 to 7) for English in the National Curriculum. The table of items on this page shows the level for each item. Items are presented in increasing order of difficulty, so level 2 items are presented first, then level 3 items, and so on. In the branching rules, each branch occurs at the start of a new level (see below).

This test was unaffected by item timeouts.

Test Rules

  • Scoring
    For each question, the correct response is given a score of 1, and any of the three incorrect responses is given a score of 0.
    Any items skipped due to upward branching (see below) are credited with a score of 1, as if they had been answered correctly.
    The maximum total score for the test is 36.
  • Branching rules
    The test contains 5 branch points. Each branch point consists of the first three items at a given level (except for level 7). The branch points are listed in the table below. The general principles of the branching are as follows:
    • Items are attempted in ascending order of item number; these items are grouped by level (2, 3, 4, 5, 6, 7). The rules below apply to levels 2 to 6; there is no branching at level 7.
    • Start with the first three items at each level.
    • If at least one of the first three items is incorrect, proceed to the remaining items at the same level. Then start the next level.
    • If all of the first three items are correct, skip the remaining items at that level (crediting them as though they had been answered correctly), and start the next level.
    Branch Level Branch point items If all correct, go to: If any incorrect, proceed to items:
    1 2 1-3 branch 2 (items 7-9) 4-6
    2 3 7-9 branch 3 (items 14-16) 10-13
    3 4 14-16 branch 4 (items 19-21) 17,18
    4 5 19-21 branch 5 (items 25-27) 22-24
    5 6 25-27 level 7: items 32-36 28-31
  • Discontinue rule
    Discontinue the entire test after any four consecutive incorrect items at any given level. Note that this only applies within a level; the discontinue rule is re-set at the start of each new level.

Item Variables

The item variables relating to the GOAL test, as listed in the table below, were generated automatically by programs on the web server during the course of the test. Note that the dataset only includes data for completed tests. If a twin started the test but left it unfinished, then the data for the test were not used. Note also that the variable holding the total test score was also generated automatically on the web server, so this is treated as an item variable, not a derived variable.

In most cases the values of these variables have been left unaltered, although some have been recoded during data cleaning as follows. See the web data cleaning page for further details.

  • For items skipped due to the discontinue rule, the item response variable is recoded from missing to -2, and the item score is recoded from missing to 0.
  • For items skipped and credited due to upward branching, the item response variable is recoded from missing to -3 (the item score is already recorded as 1 on the web server).
  • For items that crashed or malfunctioned in any way, the item response variable is recoded from missing to -4, and the item score is recoded from missing to 0.
  • For instances of crashed or otherwise compromised tests, the status flag is recoded from 2 to 3, the data flag is recoded from 1 to 0, and all item variables are recoded to missing (test data deleted)
  • For twins identified as random responders in this test, the status flag is recoded from 2 to 4, the data flag is recoded from 1 to 0, and all item variables are recoded to missing (test data deleted)

The test start and end dates and times, and item answer and download times, have not been retained in the dataset.

VariablesExplanationValues
lgostat1/2 Test status: outcome of test 0=not started, 1=started but not finished, 2=successfully completed, 3=test crashed or otherwise compromised, 4=random responses
lgodata1/2 Data flag: is test data present in the dataset? 0=no, 1=yes
lgowave1/2 Wave of data collection 1 (1st main wave, 2006), 2 (2nd main wave, 2007), 3 (follow-up wave, 2008)
lgotot1/2 Total score for this test, out of 36. 0 to 36 (integer values)
lgostdt1/2 Start date of the test [not in dataset] Date values
lgosttm1/2 Start time of the test [not in dataset] Time values
lgoendt1/2 End date of the test [not in dataset] Date values
lgoentm1/2 End time of the test [not in dataset] Time values
lgosess1/2 Number of sessions (at the computer) used by the twin to complete the test. Integer values of 1 or above
lgotime1/2 Time taken to complete the test, in seconds Integer values (number of seconds)
lgo01an1/2 through to lgo36an1/2 Item response (see table of items below for details) 1=A, 2=B, 3=C, 4=D (response selected).
Also -2=discontinued, -3=credited due to upward branching, -4=item crashed.
lgo01sc1/2 through to lgo36sc1/2 Item score (see table of items below for details) 0=incorrect, 1=correct
lgo01at1/2 through to lgo36at1/2 Answer time: length of time (in seconds) taken by the twin to respond to this item [not in dataset] Integer values (number of seconds)
lgo01dt1/2 through to lgo36dt1/2 Download time: length of time (in seconds) between the end of the previous item and the start of this item; time needed to download files for this item [not in dataset] Integer values (number of seconds)

Test Items

The numbering of the items, shown in the table below, equates to the numbering used in the item variables. Note that this is not necessarily the same as the order in which items were presented to twins in the test (see test rules above).

The "reference" column contains a coded string of the form X-YY-Z, containing the following information:
X: the item number in the original GOAL measure
YY: skill evaluated (CP = comprehension, EA = evaluation and understanding)
Z: item type (W = word, S = sentence, T = text)

itemlevelreferencequestionresponse A response Bresponse Cresponse Dcorrect response
121-EA-WWhich word is the odd one out? cheerfulgladhappysleepyD
222-CP-WA horse lives in a field. It also lives in a __________. cageneststablesty C
324-CP-T“Humpty Dumpty sat on a __________, Humpty Dumpty had a great fall.”

Which word has been left out?
wallfalltallcall A
426-CP-SToday I __________ a picture to hang in our kitchen.

What is the missing word?
cookedheardpaintedswamC
529-EA-TRead this information about visiting a farm:

A day on a farm is really exciting and great for all the family. Feed the animals by hand with special food. All our animals are good-natured, although please take care as they can over-eat.

Who would enjoy a day at the farm?
careless peoplefriends greedy peoplethe whole familyD
6210-CP-TRead this poem:

Solomon Grundy – born on a Monday
Christened on Tuesday
Married on Wednesday
Ill on Thursday
Worse on Friday
Died on Saturday
Buried on Sunday


What happened to him on Wednesday?
He was marriedHe was christenedHe diedHe was buriedA
7311-CP-S“The fireman was hot as he __________ water onto the flame.”

Which word best fits the gap?
drankdroppedhosesprayed D
8312-CP-S“Bill was tired because he had been __________ hard all day.”

Which word best fits the gap?
eatingshoutingsleepingworking D
9315-CP-S“Jack is tall, but John is __________ than him.”

What is missing from this sentence?
more tallertalltallertallest C
10316-EA-TRead this passage:

The weather is really hot. There is plenty to see and I’ve visited the beach every day. Tomorrow I am going to the water-park and the day after I am going to a beach party.

What is this taken from?
a dictionarya holiday brochurea postcarda weather reportC
11318-CP-TRead this advertisement:

Lost: a greyhound with white markings on face and paws, four years old, answers to the name Flash.

What has been lost?
a cata doga hamstera rabbitB
12319-EA-TPut these sentences in the correct order:

1. A prince fell in love with her and told her to let down her hair.
2. The prince climbed up her hair and rescued her.
3. Rapunzel was locked away in a tower.
1, 2, 32, 1, 33, 1, 23, 2, 1C
13320-EA-TRead this newspaper item:

After early morning showers, the day will become bright and sunny. The maximum temperature will be 18°C.

What type of article is this?
a film reviewa sports reviewa traffic reporta weather forecastD
14421-EA-WSpotaway! Your all new face cleanser, with a unique action for cleaning your skin. Powerful yet gentle.

Which word in this advertisement suggests that this is the only product of its kind?
actionnewpowerfulunique D
15424-CP-SRead this notice:

Lunches are available for children that have to be eaten in the canteen.

Which word has to take the place of ‘that’ so this sentence makes sense?
andsowhichwho A
16428-CP-TRead this extract from David Copperfield, by Charles Dickens:

I hand the first book to my mother. Perhaps it is a grammar, perhaps a history, or geography. I take a last drowning look at the page as I give it into her hand, and start off aloud at a racing pace while I have got it fresh. I trip over a word.

What does “I trip over a word” mean?
He misses a word outHe repeats a word He stops reading completelyHe stumbles in his speakingD
17429-EA-TWhich of the following would explain why Eddie feels guilty?Eddie feels guilty because he bought me a bunch of my favourite flowers for my birthdayEddie feels guilty because he bought me a present and I really liked itEddie feels guilty because he forgot to buy me a birthday presentEddie feels guilty because he organized a party for my birthday and it was a huge successC
18430-EA-T“There were no CD players when I was your age,” said Jo’s dad. “I did have a record player, though,” he added.
When Jo’s dad was young, there were two types of records. ‘Single’ records had a single song on each side. They were also called 45s, because they spun around 45 times a minute. Long playing records had several songs on them. When played, they spun 33 times a minute.


Which is used to describe the larger record?
33 Long Playing33 Single45 Long Playing45 Single A
19532-CP-WRead this extract from a brochure:

The hotel is set in the lovely Avon Valley and is adjacent to the Seaton stately home and nature park. The hotel is ideally situated for a family holiday, as many places of interest are within 30 minutes’ drive.

What does adjacent to mean?
approachingnext tooppositequite nearB
20535-CP-SWhich phrase completes this sentence?

The auction was held __________ a local charity.
apart fromin aid ofin spite ofowing toB
21536-EA-TIn 1993, the remains of an ancient community were discovered and excavated by people from the university. After a short while it was realised that the site offered a unique opportunity to show how the village had developed over the centuries. Now the heritage centre has been set up, many visitors come each year. Villagers, dressed up in period costumes, work the fields and tend the livestock.

Using evidence from this passage, who do you think were responsible for the excavations?
archaeologists mechanical diggersvillagersvisitorsA
22537-EA-TRead this poem by D. H. Lawrence:

Sea-weed swirls and sways,
As if this were a calming movement.
It rushes against the rocks,
Slipping over them like a shadow.


How does the sea-weed move over the rock?
angrily majesticallypainfullysmoothlyD
23538-EA-TThe hotel is set in the famous and beautiful Rhondda Valley and adjacent to the Heritage Park centre and museum. It is ideally situated to explore the South Wales area, including the Brecon Beacons and Cardiff, which is a 20-minute journey by car.

From what type of text is this extract taken?
a history booka holiday brochurea leaflet from an estate agenta road atlasB
24539-CP-TThe snow has gone from cottage tops
The thatch moss glows in the brighter green
And eves in quick succession drops
Where grinning icicles once hath been
Pit patting wi’ a pleasant noise
In tubs set by the cottage door
And ducks and geese wi’ happy joys
Douse in the yard pond brimming o’er.


What time of year is it, according to the poem?
It is Autumn and it is rainingIt is Springtime and the snow has thawedIt is Summertime and everything is greenIt is Winter and it is snowingB
25642-CP-S“Charley was late for school today. __________, she was late yesterday.”

Which of these best links these two sentences?
FurthermoreIn factMeanwhile SecondlyA
26645-CP-WRead the following and answer the question below:

It has recently been reported that a computer bug has been discovered in the software used by National Lottery retailers. This bug has deprived some retailers of revenue and even some punters of prizes totaling £20 000.

What are the punters mentioned in the passage?
bookmakers customerslosersretailersB
27646-EA-THere is an advert from a newspaper:

"Remedies with Roots"
Nature has provided many useful things! It is much better to use natural substances than artificial chemicals
We do not use animal products at all. Furthermore, we only use materials from plants that have been grown naturally, without chemical fertiliser and from crops that do not use genetically modified seeds. Ginger and ginseng roots provide a balanced basis for our vitamin supplement pills.


What is being advertised?
herbal medicinesorganic foods seeds and fertilisershair conditionersA
28647-CP-WRead this paragraph from a travel book:

For more than five hundred years, the quaint little village had rested on the sandy shores of the sparkling sea, at the foot of a giant volcano. Then came the 21st century with its tourists and cruise liners and the opening of the Peaceful Palms Resort – a special hideaway for fortunate vacationers. However, then a great storm changed everything – a furious, unrelenting hurricane catching the fleet of tourist ships by surprise and tossing them about like toy boats for one frightening afternoon.

What are vacationers?
cruise ship ownersholidaymakershotel ownerssailors B
29648-EA-TRead this extract:

Once again football has been let down by a small minority of fans. We are used to fighting between rival fans, but yesterday’s events are both new and disturbing. There has been talk of both English and German troublemakers joining forces before, but for the first time this has actually happened.

What event surprised the writer of this article?
The English and German fans fought each other The English and German fans fought together against Turkish fans English, German and Turkish fans all fought each otherThe security forces fought the fansB
30649-EA-TWorking at the .com company was such a good experience. Everyone was young and so cool. The place really buzzed. We all had attitude: the buyers, the marketing people, the web designers, the managers – and the techies. Most of us were straight from college, sadly, with little knowledge of business.

Who is the author of this article?
a former employee of the .com company an employee of a competitive firmthe Managing Director of a competitive companythe Managing Director of the .com company A
31650-CP-TRead this passage and answer the question that follows:

“You should honour your father and mother, not spend every evening clubbing, and take some ‘A’ levels. One day you will have children yourselves,” said their parents.

What does not spend every evening clubbing, and take some ‘A’ levels reveal about the parents in the extract?
They are earnestThey are flippantThey are ineffectualThey are strictA
32751-EA-THere is a stanza from the poem The Ballad of Reading Gaol, by Oscar Wilde:

In Reading Gaol by Reading town
There is a pit of shame,
And in it lies a wretched man
Eaten by teeth of flame,
In a burning winding-sheet he lies,
And his grave has got no name.


Which of these sentences below most accurately summarises these lines of verse?
A man has been trapped in a mining accidentA man awaits executionAn executed prisoner’s body has been buriedA prisoner is on fire C
33756-EA-TRead this passage from Travels with a Donkey, by Robert Louis Stevenson:

For my part, I travel not to go anywhere, but to go. I travel for travel’s sake. The great affair is to move; to feel the needs and hitches of our life more nearly; to come down off this feather-bed of civilisation, and find the globe granite underfoot and strewn with cutting flints. Alas, as we get on in life, and are more preoccupied with our affairs, even a holiday is a thing that must be worked for. To hold a pack upon a pack-saddle against a gale out of the freezing north is no high industry, but it is one that serves to occupy and compose the mind. And when the present is exacting, who can annoy himself about the future?

What is the writer’s attitude to travel when the going gets tough?
He admits that he begins to lose his enthusiasm for travelingHe becomes pessimistic about his future prospectsHe enjoys the extra concentration on the moment that is requiredHe takes it in his stride without increasing his effortC
34758-EA-TThis quotation appears at the end of a report in a newspaper on a survey of teenage culture and habits:

Dr Sian Pitt, clinical psychologist at a well known teaching hospital, made the following comments on a recent government study: “This study highlights the fact that teenagers today are bombarded with images of people whom they ought to find attractive. Too often, boys are put under tremendous pressure to conform to these ideals if they are to achieve self esteem.”

Which headline do to think appeared on this report?
Brains? We’d much rather have the looksBoys trail girls in exam passesGirls under peer group pressureExpert challenges teenage survey resultsA
35759-CP-TRead this passage:

Valerie had taken a long time to get used to her new life in India. The cold, wet, unpleasant weather of Scotland, her home, seemed an age ago. No more green fields, just brown earth and occasional crops. Valerie loved to wake up knowing that it would be a hot day. It was pure joy, even if her new found friends and servants could at times be a little irritating.

What did Valerie grow to like most about her life in India?
having servantsher Indian friendsthe heatgreen fields C
36760-CP-T“John’s behaviour has changed as time has gone by. He has become quiet now, as his anger has subsided. The first week after his attack he had been violent towards everyone. Then one day he was heard muttering to himself: ‘It’s all over now; It’s over now.’”

What happened to John after his attack?
For the first week he was quiet, and then he became violent For the first week he was violent and then he became quietHe alternates daily between being violent and quietHe grows increasingly violent every dayB