The Web Activities
After logging in as outlined above, and after the consent form had been completed (see the login and consent page for more details), each family was presented with a screen containing links to the activities for each twin. Clicking on one of these links led to the respective twin's menu of activities, such as the one shown below (except that the text "Twin 1" and "Twin 2" were replaced by actual twin names):
The twin activities were always presented in the order shown, and this was the order in which twins were required to complete the activities. For example, the link to "Word Quiz" would not work until the twin had first completed the "Introduction". Moving the mouse over the green dot next to each activity name would reveal a message displaying the expected range of times that the activity was expected to take (these time ranges were based on measurements during piloting). The twin activities were as follows (click on the links to go to a detailed description of each web test):
- Introduction: a tutorial, incorporating animations and audio instructions, to introduce twins to the web tests
- Word Quiz: the Vocabulary test (expected time 4 to 6 minutes)
- Discovery: the Science test (expected time 5 to 25 minutes)
- Pattern Game: the Ravens Matrices test (expected time 5 to 20 minutes)
In addition to the "Introduction", which was a general tutorial describing how all the tests should be conducted, each individual web test started with its own short tutorial. The tutorials generally started with an introduction to the test (with audio and animations), followed by one or more practice examples for each twin to try out. These practice items gave feedback, for instance pointing out the correct answer if the twin answered wrongly; such feedback was not given in any of the main test items.
Parents were asked to ensure that each twin completed the tests independently. Each twin had their own independent menu of activities (as shown above). Although twins generally had to take turns to complete their activities on the home computer, they were able to do this in a flexible way, so that one twin's progress through the tests was not constrained by the other twin's progress.
On completion of the final web test (Ravens, also called Pattern Game), each twin was presented with a screen congratulating them and informing them that a reward voucher would soon be on its way.
General Test Rules
Each web test had its own set of specific rules, for example for scoring and discontinuing: these test rules are described in detail in the pages for each web test (see links above). However, there were several general test rules that affected all of the tests. These rules were programmed into the web tests, and were enforced automatically. The rules were as follows:
- One attempt at each test.
Each of the three web tests (not including the Introduction) could be attempted once and only once by each twin. There was no mechanism for re-setting tests, even if parents were aware of problems and asked for tests to be repeated. - One attempt at each item.
Every item in each of the three web tests could be attempted once and only once by each twin. If a twin attempted to repeat an item, for example by clicking the "Back" button in the browser, then the test would be stopped and the twin would be presented with a message explaining the problem. The twin could then resume the test as usual from the menu of activities. - Come Back Later.
In each item of every web test, there was a "Come Back Later" button. Clicking on this button would halt the web test. The twin could then resume the test at any later time, by selecting the test from the menu of activities in the usual way. The twin would then continue at the same item in which they clicked "Come Back Later". This facility was provided to allow for interruptions to the twins during tests, and to make the tests as flexible as possible in terms of time (for example, a twin could complete a test in one go, or in several sessions spread over different days). - Timing out during test items.
All three web tests had a built-in timeout of 5 minutes for each item. If a twin did not respond (with mouse clicks) during a test item, audible prompts were played after 1.5 minutes, 3 minutes and 4.5 minutes to encourage the twin to complete the item. After 5 minutes on screen with no response from the twin, the item would end and the item score would be forfeited (zero score). The item would then be replaced on screen with a "next item" button. The twin could then resume the test at the next item by clicking on this. If the "next item" prompt is ignored (for example, if the twin has left the computer for an extended period), then the more general timeout would eventually be reached (see below), and the twin would be logged out. - Timing out generally.
The web site as a whole had a built-in session timeout of 15 minutes. This means that after 15 minutes with no activity (no clicking on the screen), the session ended and twins or parents were logged out. They were then taken back to the login page. During the tests themselves, shorter item timeouts applied (as described above). The longer 15 minute timeout would apply at any other time after logging in, for example on the consent form, the twin menu of activities, or the "next item" prompt. The timeout is a routine security measure, to protect logged in sessions. - No feedback.
During the tests, no feedback was provided to tell twins whether they had answered each item correctly or incorrectly, or to give twins any idea of their overall score in a test. A twin's route through a test, determined by the discontinue rules, was always hidden from the twin. The no-feedback rule was partly a means of preventing "cheating" or collaboration between twins; it was also intended to avoid discouraging twins after incorrect answers.
Web Callers
Some families in cohort 1 were assigned to callers: web callers, language study callers, or teacher consent callers (see the main 14 Year page for explanation of the caller types). In the context of the web tests, web callers and language callers fulfilled the same functions (although language callers had the additional duty of carrying out the telephone tests); in the description below, "web caller" refers to both types of caller. These callers were staff employed by TEDS to telephone the families during the web study. The callers fulfilled various functions:
- Collection of verbal consents (or opt-outs) for the web study.
- Encouraging families to complete the web tests, by talking to parents or to the twins themselves.
- Offering basic technical support to the families, to help with completion of the web tests (for example, help with use of a browser, or identifying whether or not a family's computer met the necessary requirements).
- Collection of feedback from the families. This was not done systematically, but any feedback offered by families was fed back to TEDS by callers.
- Collection of parental consent (or refusal) to contact the twins' teachers, with teacher contact details, where this had not been returned previously.
- Collection of any other relevant family details communicated by the families, for example changes of address, or twin medical conditions.
Callers were required to keep track of their allocated families using specially-designed pages in the TEDS web site. Each web caller was issued with their own login (username and password) for the web site. Once logged in, web callers could view detailed information describing the web activity of families allocated to them, for example how far each twin had got in each web test, and the dates and times when test items had been attempted. Other web pages were provided for web callers to log details of telephone calls made to families.
Other information collected from families by web callers, such as opt-outs, teacher details, and changes of address, were communicated to the TEDS office by telephone, email or post. Web callers were encouraged to refer back to the TEDS office if unable to help families themselves with particular problems.