TEDS Data Dictionary

TEDS Study Data Returns

Contents of this page:

Introduction

This page summarises and compares some of the data returns for the main TEDS studies. More detailed figures for individual studies can be found by following the links to the left.

For comparability between studies, four basic types of data collection are examined on this page: parent booklets/questionnaires, twin booklets/questionnaires, twin cognitive tests, and teacher questionnaires.

The percentage return rate, expressed as a fraction of the number of families contacted, has in general declined over the course of time, with sample attrition as the most obvious cause. However, other factors have caused variations in the trends, and some of these factors are discussed in context below. Significant factors include the type and frequency of contact with the families; the degree of selection used in choosing the study sample; and the transition of twins from primary to secondary school. The samples selected for different TEDS studies are compared on another page.

Parent questionnaire returns

This table includes all the main TEDS studies in which parent data were collected in bulk by means of a booklet or questionnaire (often sent together with twin booklets). Note that at age 21, parents could use paper booklets but they could also use the web or a phone app to return the same data; at earlier ages, paper booklets were generally used.

Study Number of parents contacted Number of parent returns % return rate
1st Contact 16302 13488 82.7%
2 Year 10646 7008 65.8%
3 Year 9350 6119 65.4%
4 Year 12528 8198 65.4%
7 Year 14581 7909 54.2%
8 Year 13941 6792 48.7%
9 Year 7531 3385 44.9%
12 Year 8438 5854 69.4%
14 Year booklet 11118 3376 30.4%
14 Year SLQ 10936 3561 32.6%
16 Year 10874 5123 47.1%
TEDS 21 10448 5103 48.8%

This table clearly shows an overall decline in the % return rate, but with variations possibly due to the following factors:

  • Sample selection. Samples selected on the basis of recent data returns are likely to give a higher % return rate. This is apparent in the 12 Year returns, and perhaps to a lesser extent in the 3 and 4 Year returns.
  • Telephone contact. Higher response rates may be observed when families are contacted by telephone, than when the contact is entirely via mail. There were extensive telephone contacts with families during the 7, 12 and 21 Year studies.
  • Prior consent. In the 9 Year study, written consent was sought before booklets were sent (in other studies, consent forms were generally sent and returned simultaneously with the booklets). This two-stage process of data collection may have resulted in a drop in overall return rate.
  • Other factors that may have affected returns, but whose effects are difficult to judge from the raw returns figures, are the nature and length of the questionnaire; the timing of sending the questionnaire; the number and frequency of reminders sent; other simultaneous demands placed on families (e.g. web or phone tests); the method of booklet data collection (paper and/or web and/or app); and whether or not vouchers or other rewards were simultaneously offered for the return of twin data.

Twin questionnaire returns

This table includes all the main TEDS studies in which twin questionnaire data were collected in bulk (as distinct from twin cognitive test data below). At ages 9, 12 and 16 these were exclusively paper questionnaires. At age 14, paper booklets were used but with the option of using the web. The 18 Year Fashion questionnaire involved cohort 3 only, and was delivered exclusively via the web. In TEDS 21, twins had the options of using a phone app, the web or a paper booklet to return the same questionnaire. However, in the 21 year covid study, the only option was a web questionnaire.

Study Collection
method
Number of twin pairs: % complete
data return rate
% partial
data return rate
contacted where both
twins finished
with partial data
(only one twin and/or
incomplete data)
9 Year paper 7531 3405 - 45.2% -
12 Year paper 8438 5883 - 69.7% -
14 Year paper or web 11118 3176 366 28.6% 3.3%
16 Year booklet paper 10874 5078 68 46.7% 0.6%
16 Year GCSEs * paper or phone 10613 6705 140 63.2% 1.3%
18 Year A-levels * paper or phone 10588 7068 208 66.8% 2.0%
18 Year Fashion web 3166 1305 503 41.2% 15.9%
TEDS 21 phase 1 app, web or paper 10535 4127 1784 39.2% 16.9%
TEDS 21 phase 2 app, web or paper 8611 3535 1756 41.1% 20.4%
21 Year covid phase 1 web 6674 ** 1494 1931 22.4% 28.9%

* The exam results questionnaires at ages 16 (GCSEs) and 18 (A-levels) were collected from parents as well as from twins. Where twins could not be persuaded to return the questionnaires on paper, parents were called and were asked to give the twins' exam results by phone. Hence a significant portion of the data returned was from parents.

** In the covid study, in phase 1, 1271 unpaired twins were contacted in addition to the 6674 pairs. However, most data returns came from the latter group.

The % return of complete data has fluctuated greatly, due to a variety of factors discussed above and below. However, the pattern in the % return of partial data is clearer: this has increased significantly, especially since the introduction of electronic data collection (web or app).

Some of the factors affecting parent questionnaire data returns (see above) will also apply here to the twin questionnaire data returns. In fact, in the booklet studies at ages 9, 12, 14 and 16 the twin pair returns are almost identical to the parent data returns; this was because the parent and twin booklets were generally sent and returned as a set together. The following additional factors may also have contributed to variations in the % data return rate for the twin questionnaires at later ages:

  • Electronic data collection. The use of the web (and later a phone app) to collect questionnaire data relies increasingly on independent participation of each twin, hence the increasing % of partial data. This first became evident at age 14 (where some but not all twins used the web) then much more so at ages 18 and 21.
  • The special case of exam results. The exam results data collections (GCSEs at 16, A-levels at 18) were unusual in that the content was factual and brief, could be collected from parents if twins did not respond, and could be collected entirely by phone in a short interview. These factors largely account for increased data returns.
  • Nature and length of questionnaire. The exam results questionnaires, the Fashion questionnaire and the covid questionnaire were all short, contributing to improved data returns. The nature of these questionnaires may also have been more appealing to families, who generally seemed very willing to share exam results, and who may have been keener to give their opinions on fashion/food/music and the covid crisis than to answer the more conventional behaviour questionnaires.
  • Time scale for data collection.
    The Fashion study data collection, and each phase of covid questionnaire data collection, was restricted to roughly a month, giving little time for the usual reminders. Furthermore, in the covid study only email contacts were used, as the circumstances did not allow for sending postal invitations or for telephone calling. Both the Fashion and covid questionnaire were similarly brief (roughly 15 minutes to complete). These factors make them difficult to compare with other studies. However, possible reasons why data returns were higher in Fashion than in the covid study could include voucher rewards (given for the former but not the latter) and age effects (the covid study took place roughly 5 years after the Fashion study).

Twin test data returns

This table includes the main TEDS studies in which twins were asked to complete cognitive and other tests, either by telephone (at 7) or via the web (at 10, 12, 14, 16 and 18). Parents were asked to give consent before twins started the tests, up to age 16; both written and verbal consents were used at 7, while on line consent was required before the web tests could be started at 10, 12, 14 and 16 (written and verbal consents were also sought at these ages, but these were additional to the on line consent). From age 18 onwards, no parental consent was sought because twins were adults; on-line twin consent was built into the start of the tests themselves, and is not shown separately in the table below.

Study Number of families (twin pairs): % parental consent rate % complete data return rate % partial data return rate
contacted giving parental consent for
twins to do the tests
where both twins
completed all of the tests
with partial data
(only one twin and/or incomplete data)
7 Year 9811 5727 5533 - 58.4% 56.4% -
10 Year 5944 3395 2635 604 57.1% 44.3% 10.2%
12 Year 8438 5899 3993 2099 69.9% 47.3% 24.9%
14 Year 11005 4072 2449 1300 37.0% 22.3% 11.8%
16 Year 6281 3279 2214 952 52.2% 35.2% 15.2%
18 Year Perception 2382 - 955 386 - 40.1% 16.2%
18 Year Bricks 2184 - 1266 480 - 58.0% 22.0%
18 Year Kings Challenge 3042 - 1014 936 - 33.3% 30.8%
18 Year Navigation 5509 - 860 1503 - 15.6% 27.3%
21 Year G-game 6673 * - 1470 1951 - 22.0% 29.2%

* 1273 unpaired twins were contacted in addition to the 6673 pairs; however, most of the data returns came from the latter.

Some of the factors affecting parent data returns (see above) will also apply here to the % parental consent rate. For example, sample selection (particularly at 12 and 18, and to a lesser extent at 10); and the degree of telephone contact with families (used extensively at 7, 10, 12 and 16, but much less so at 14 and not at all at 18).

Similarly, some factors affecting twin questionnaire data returns (see above) will also apply here to twin test data returns. For example, longer batteries of tests may be linked to lower data returns (the web batteries at 12 and 16 were much longer than those at 10 and 14, while the Kings Challenge and Navigation batteries were longer than those of Perception and Bricks). The 21 Year g-game was short, but on the other hand the time scale for data collection was short, with few reminders, and there were no twin rewards on offer apart from a prize draw.

The following additional factors may also have contributed to variations in the % data return rate for the twin cognitive studies:

  • Voucher rewards. These were introduced in the 10 year study, and were used again at 12, 16 and all the 18 year studies, to reward twins for completing the web tests. However, vouchers were not offered in the 14 year study, except in cohort 1. This helps to explain the significant drop in returns of twin data at age 14 compared with most studies before and after. Vouchers were not offered in the 21 year g-game (except in a prize draw)
  • Twin age. The difference between the consent rate and the data return rate was narrower at 7 than at the later ages; this perhaps reflects increasing levels of twin independence with age. Increasing twin independence may also help to explain the generally increasing % of partial data returns.
  • Internet connections. At the time of the 10 year study, a significant number of families had no home computer, had no internet connection at home, or had slow dial-up internet connections. By the time of the 12 year and later studies, home computers with broadband connections were becoming the norm. This may have been a factor contributing to the relatively low % data return rate at age 10.
  • Technical problems and twin fatigue. Many twins experienced technical problems with the Navigation activities, and to a lesser extent with the Kings Challenge activities, and this may have discouraged participation and led to an increase in partial data returns. Furthermore, broadly the same sample of twins (subsets of cohorts 1 and 2) were invited to take part in Perception, Bricks, Kings Challenge and Navigation, the latter three studies all starting within the same year; this may help to account for the drop in returns in the latter two studies, even though the activies were "gamified" in an attempt to make them more visually appealing.

Teacher questionnaire returns

Collection of teacher data at each age involved several steps: firstly, the parent was asked for consent for TEDS to contact the twins' teachers; at the same time, the teachers' names and school addresses were sought; then questionnaires were sent to teachers. In some cases, twin pairs were taught in the same classroom, so the two questionnaires could be sent simultaneously to the same teacher; usually, the two questionnaires were then returned in the same envelope. In other cases, the two twins were separated at school, so the two teacher questionnaires had to be sent and returned independently.

In primary schools, the contacted teacher was usually the teacher who taught the twin's class full time, for most or all subject areas. However, in secondary schools, where children generally received specialist subject teaching from a range of teachers, the contacted teacher was usually the form teacher (who took registration and had daily contact with the children).

School phase Study Number of families: % parental
consent rate
% data return
rate (overall)
% with data returned
for only one twin
contacted gave parental consent teacher qnrs sent both returned only one returned
Primary 7 Year 14581 7600 7526 6163 396 52.1% 84.5% 5.3%
9 Year 7531 3869 3859 2746 363 51.4% 75.9% 9.4%
10 Year 5849 3891 3886 2880 374 66.5% 78.9% 9.6%
12 Year
(cohorts 3 and 4)
3552 2877 2866 2358 203 81.0% 85.8% 7.1%
Secondary 12 Year
(cohorts 1 and 2)
4886 3491 3470 2048 892 71.4% 71.9% 25.7%
14 Year
(cohort 1)
2487 1326 1323 703 336 53.3% 65.8% 25.4%

The % data return rate was significantly lower from secondary school teachers (approx. 65-70%) than from primary school teachers (approx. 75-85%). Feedback from some form teachers that were contacted in secondary schools indicated that they did not always know the twins well enough to be able to fill in the questionnaires confidently; they were often not the twins' subject teachers, and were frequently unable to fill in the academic achievement part of the questionnaire. Other variations in the % return rate may be related to factors such as the timing and frequency of reminders sent to teachers, the length of the questionnaire (much longer at 9 than at 7), and so on.

At primary school, the majority of twin pairs had the same teacher for both twins; the teacher questionnaires were therefore usually returned together, and there were relatively few twin pairs (approx. 5-10%) for whom only one teacher returned data. However at secondary school, the majority of twin pairs were split up, and the two teacher questionnaires were usually returned independently by two separate teachers for each twin pair. Hence the increased proportion (approx. 25%) of twin pairs with teacher data returned for only one twin.

Variations in the % parental consent rate are similar to the variations in % return rate for the parent data, and to the variations in % consent rate for the twin tests, as described above. Sample selection was probably an important factor in the increased consent rate at 12, and to some extent at 10. The amount of telephone contact also varied considerably: at 10 and 12, and to a lesser extent at 14, many parents were telephoned to collect teacher consent details, whereas at 7 and 9 these were collected in writing by mail.