The Web Activities
After logging in as described above, and after the consent form and parent questionnaire had been completed, each family was presented with a screen containing links to the activities for each twin. Clicking on one of these links led to the twin's menu of activities, such as the one shown below (except that "Twin 1" and "Twin 2" were replaced by actual twin names):
The twin activities were always presented in the order shown, and this was the order in which twins were required to complete the activities. For example, the link to "Spot the Picture Game" would not work until the twin had first completed the "Introduction". The twin activities were as follows (click on the links to go to a detailed description of each web test):
- Introduction: a tutorial, incorporating animations and audio instructions, to introduce twins to the web tests
- Spot the Picture Game: the PIAT test
- Number Game: the Mathematics test
- Tell Us About You: the Maths and Reading Questionnaire, incorporating the Author Recognition test
- Pattern Game: the Ravens Matrices test
- Word Quiz: the Vocabulary test
- What's Missing: the Picture Completion test
- General Knowledge Quiz: the General Knowledge test
In addition to the "Introduction", which was a general tutorial describing how all the tests should be conducted, each individual web test started with its own short tutorial. The tutorials generally started with an introduction to the test (with audio and animations), followed by one or more practice examples for the twins to try out. These practice items gave feedback, for instance pointing out the correct answer if the twin answered wrongly; such feedback was not given in any of the main test items.
Parents were asked to ensure that each twin completed the tests independently. Each twin had their own independent menu of activities (as shown above). Although twins generally had to take turns to complete their activities on the home computer, they were able to do this in a flexible way, so that one twin's progress through the tests was not constrained by the other twin's progress.
The tests as listed above were interspersed with "bonus games". After completion of each web test (not including the Introduction), the link to the web test in the menu of activities was replaced by a link to a new bonus game. These were short computerized games, which were provided for light relief and as a reward to twins for their efforts in the tests. Twins could choose to ignore the bonus games, or could play them repeatedly if they wished (unlike the tests, which were compulsory and could only be attempted once).
On completion of the final web test (General Knowledge), each twin was presented with a screen congratulating them and informing them that a reward voucher would soon be on its way.
General Test Rules
Each web test had its own set of specific rules, for example for scoring, branching and discontinuing: these test rules are described in detail in the pages for each web test (see links above). However, there were several general test rules that affected all of the tests. These rules were programmed into the web tests, and were enforced automatically. The rules were as follows:
- One attempt at each test.
Each of the seven web tests (this does not include the Introduction or the bonus games) could be attempted once and only once by each twin. There was no mechanism for re-setting tests, even if parents were aware of problems and asked for tests to be repeated. - One attempt at each item.
Every item in each of the seven web tests could be attempted once and only once by each twin. If a twin attempted to repeat an item, for example by clicking the "Back" button in the browser, then the test would be stopped and the twin would be presented with a message explaining the problem. The twin could then resume the test as usual from the menu of activities. - Come Back Later.
In each item of every web test, there was a "Come Back Later" button. Clicking on this button would halt the web test. The twin could then resume the test at any later time, by selecting the test from the menu of activities in the usual way. The twin would then continue at the same item in which they clicked "Come Back Later". This facility was provided to allow for interruptions to the twins during tests, and to make the tests as flexible as possible in terms of time (for example, a twin could complete a test in one go, or in several sessions spread over different days). - Timing out during test items.
The PIAT and Picture Completion tests had built-in time limits of 20 seconds for answering each item. However, the web tests more generally had a built-in timeout of 5 minutes for each item. If a twin did not respond (with mouse clicks) during a test item, audible prompts were played after 1.5 minutes, 3 minutes and 4.5 minutes to encourage the twin to complete the item. After 5 minutes on screen with no response from the twin, the item would end and the item score would be forfeited (zero score). The item would then be replaced on screen with a "next item" button. The twin could then resume the test at the next item by clicking on this. If the "next item" prompt is ignored (for example, if the twin has left the computer for an extended period), then the more general timeout would eventually be reached (see below), and the twin would be logged out. - Timing out generally.
The web site as a whole has a built-in session timeout of 15 minutes. This means that after 15 minutes with no activity (no clicking on the screen), the session ends and twins or parents are logged out. They are then taken back to the login page. During the tests themselves, shorter item timeouts apply (as described above). The longer 15 minute timeout would apply at any other time after logging in, for example on the consent form, the parent questionnaire, the twin menu of activities, or the "next item" prompt. The timeout is a routine security measure, to protect logged in sessions. - No feedback.
During the tests, no feedback was provided to tell twins whether they had answered each item correctly or incorrectly, or to give twins any idea of their overall score in a test. A twin's route through a test, determined by branching and discontinue rules, was always hidden from the twin. The no-feedback rule was partly a means of preventing "cheating" or collaboration between twins; it was also intended to avoid discouraging twins after incorrect answers.
Web Callers
All families in cohort 1, and the majority of families in cohort 2, were assigned to web callers. Web callers were staff employed by TEDS to telephone the families during the web study. The callers fulfilled various functions:
- Collection of verbal consents (or opt-outs) for the web study.
- Encouraging families to complete the web tests, by talking to parents or to the twins themselves.
- Offering basic technical support to the families, to help with completion of the web tests (for example, help with use of a browser, or identifying whether or not a family's computer met the necessary requirements).
- Collection of feedback from the families. This was not done systematically, but any feedback offered by families was fed back to TEDS by callers.
- Collection of parental consent (or refusal) to contact the twins' teachers, with teacher contact details, where this had not been returned previously.
- Collection of any other relevant family details communicated by the families, for example changes of address, or twin medical conditions.
Web callers were required to keep track of their allocated families using specially-designed pages in the TEDS web site. Each web caller was issued with their own login (username and password) for the web site. Once logged in, web callers could view detailed information describing the web activity of families allocated to them, for example how far each twin had got in each web test, and the dates and times when test items had been attempted. Other web pages were provided for web callers to log details of telephone calls made to families.
Other information collected from families by web callers, such as opt-outs, teacher details, and changes of address, were communicated to the TEDS office by telephone, email or post. Web callers were encouraged to refer back to the TEDS office if unable to help families themselves with particular problems.