The Web Activities
After logging in as described above, and after the consent form had been completed, each twin was presented with the first web activity. If a twin had previously logged in and provided consent, then the consent form would not be shown again; if a twin had previously completed one or more of the activities, then the next activity would be shown; if a twin had previously completed all the activities, then a feedback or summary page would be shown.
Some studies included cognitive tests (Face and Cars in the Perception Study, the 6 subtests of the Bricks Study, and the 10 subtests of the Kings Challenge Study, the 30 missions of the Navigation Study). Each of these tests and subtests started with its own short tutorial. Each tutorial presented brief instructions for completing the test or subtest, typically with an example item followed by a very simple practice item for the twins to try out. In the Percepion and Navigation studies (but not in Bricks or Kings Challenge), if a twin gave an incorrect response to the practice item, they were made to repeat the practice item until they gave the correct response before proceeding with the main test.
Within each web study, the activities were always presented in a fixed order as shown below, and this was the order in which twins were required to complete the activities
Perception Study Activities
- Consent
- Face Perception test
- Perception questionnaire
- Cars Perception test
- Comments page
- Feedback page
The comments page presented twins with a text box in which they were invited to give feedback or other comments on the activities. This was optional, so twins were allowed to leave the text box empty and proceed directly to the feedback page.
Bricks Study Activities
- Consent
- Spatial Abilities (SPAA) questionnaire
- Bricks tests (6 subtests)
- Feedback page
The consent and feedback pages are not reproduced here. The consent page was almost identical to that used for the Kings Challenge study (see below). The feedback page was very similar in format to that used in the Perception study (see above). Note that there was no comments page in this study.
Kings Challenge Study Activities
- Consent
- Cross-sections test
- 2D drawing test
- Pattern assembly test
- Elithorn mazes test
- Mechanical reasoning test
- Paper folding test
- 3D drawing test
- Shape rotation test
- Perspective taking test
- Mazes test
- Feedback page
Note that there was no comments page in this study. A brief demonstration video of the Kings Challenge activities is available on an external YouTube page.
Navigation Study Activities
- Consent
- Introduction and practice activities
- Orientation direction mission 1
- Scanning mission 1
- Orientation landmarks mission 1
- Perspective mission 1
- Map reading no memory mission 1
- Orientation landmarks mission 2
- Orientation direction mission 2
- Map reading no memory mission 3
- Perspective mission 2
- Orientation direction mission 3
- Map reading with memory mission 1
- Scanning mission 2
- Orientation landmarks mission 3
- Perspective mission 3
- Map reading with memory mission 2
- Orientation direction mission 4
- Map reading no memory mission 2
- Scanning mission 3
- Map reading no memory mission 4
- Perspective mission 4
- Orientation landmarks mission 4
- Map reading no memory mission 5
- Scanning mission 4
- Map reading with memory mission 5
- Orientation landmarks mission 5
- Perspective mission 5
- Map reading with memory mission 3
- Scanning mission 5
- Map reading with memory mission 4
- Orientation direction mission 5
- Feedback page
The numbering of missions is not always in sequence order, due to changes made in the ordering of mssions during piloting. Note that there was no comments page in this study. A brief demonstration video of the Navigation activities is available on an external YouTube page.
Fashion, Food and Music Preferences Study Activities
- Consent
- Questionnaire:
- Fashion preferences questionnaire
- Food preferences questionnaire (divided into 3 sections)
- Music preferences questionnaire
The consent page is not reproduced here, but it was very similar in format to that used in the Kings Challenge study (see above). Note that there was no comments page and no feedback page in this study.
General Test Rules
Most web activities had simple rules. There was no branching. Some tests had item time limits, and others did not. Some tests had discontinue rules, and others did not. All test rules were programmed into the web activities, and were enforced automatically. The following list describes in general terms the broad rules that applied across most or all tests; follow the links above for more detailed descriptions of test-specific rules. Note that Navigation activities often followed a different pattern from more conventional web tests.
- No halting and returning in mid-test
Having started but not finished an activity, it was generally not possible for a twin to halt (by logging out or closing the browser) then return at the same point at a later time. Generally, if a twin stopped in this way in mid-activity, then all the data for that activity would be lost; on logging in at a later time, the twin would then have to re-start the same activity. In Navigation, this rule applied at the level of each mission (if not completed, the mission would be re-started at the first task/attempt). The exception to this general rule were the Kings Challenge subtests, where an interrupted item would be forfeited, but on logging in again at a later time, the twin would resume the same test at the next item. - One attempt at each activity
Each activity within each web study could be attempted once and only once by each twin (except as described above, after halting in mid-test then re-starting). There was no mechanism for re-setting the activities once completed, even if twins were aware of problems and asked for tests to be repeated. - One attempt at each item
Every page (containing one test item or several questionnaire items) in each of the web activities could be attempted once and only once by each twin (except as described above, after halting in mid-test then re-starting). If a twin attempted to repeat a test item, or a page of questionnaire items, for example by clicking the "Back" button in the browser, then the activity would be halted and the twin would be presented with a message explaining the problem. The twin would then have to re-start the activity (except in Kings Challenge, where the twin would re-start at the next item in the same test). In Navigation, the rules of some missions deliberately allowed twins to make more than one attempt at completing each mission; however, clicking "Back" would result in an entire mission being re-started. - Timeout rules
Some but not all of the cognitive tests had their own specific timeout rules. For example, the Bricks, Kings Challenge and Navigation subtests all had timeout rules, but the Perception Study tests did not. Generally (except for Navigation missions), in items of a test with a timeout rule, if a twin did not select a response within the programmed time limit, the item would be forfeited with zero score. The item would then be replaced on screen with a "next item" button, and the twin could resume the test at the next item by clicking on this. (No timeout rule applied to the "next item" page itself.) Navigation missions had more complex behaviour. See the descriptions of individual tests for details of the rules used. In activities without timeout rules (Perception activities, Bricks questionnaire, FFMP questionnaires), a twin could pause almost indefinitely on any given item. - Discontinue rules
Some but not all of the cognitive tests had discontinue rules. These rules were designed to shorten the duration of each test, and to avoid presenting items of inappropriate levels of difficulties, to twins who had reached a ceiling of difficulty level in the test. See the descriptions of individual tests for details of the rules used. Where no discontinue rule was present in a test, twins were obliged to complete every item in the test. - Limited feedback
With the exception of Navigation tasks, cognitive tests did not provide feedback to inform twins whether they had answered each item correctly or incorrectly. However, feedback relating to performance in the battery as a whole was given in the Perception, Bricks, Kings Challenge and Navigation studies: on completion of the entire battery of activities a twin was presented with a feedback page summarising overall performance (the nature of the feedback varied between studies). This arrangement was designed to hide the correct item responses in cognitive tests (except in Navigation), in order to prevent cheating or collaboration between twins, while providing general feedback in an attempt to make the test outcomes more interesting to twins.