TEDS Data Dictionary

The 10 Year Raven's Progressive Matrices Web Test

Contents of this page:

Introduction

This page describes a version of the Raven's Progressive Matrices Test (or Raven's for short) that was used as part of the 10 Year twin web study battery.

Description of Test

This test consists of a series of incomplete patterns ("matrices"); in each case, the twin was asked to identify the missing part of the pattern. The twin did this by clicking on one of 6 or 8 possible missing parts. The patterns and missing parts are shown in full in a table below.

The test is divided into 5 sub-tests or sections, labelled A, B, C, D and E. Each sub-test consists of 12 items, numbered 1-12. Hence there are 60 items in total: A1-A12, B1-B12, C1-C12, D1-D12 and E1-E12. A twin may have been presented with fewer than 60 items, because of the branching and discontinue rules (described below). The sub-tests are presented in sequence (A then B then C then D then E). Branching and discontinue rules apply independently within each sub-test, as described below.

Test Rules

  • Scoring
    For each question, the correct response is given a score of 1, and any of the 5 or 7 incorrect responses is given a score of 0. The maximum total score for the test is 60.
  • Branching and Discontinue rules
    The 5 sub-tests are presented in sequence: A then B then C then D then E. The following rules apply independently within each of the 5 sub-tests.
    • Start with items 1, 2 and 3 in the sub-test.
    • If items 1-3 are all incorrect, discontinue the sub-test (skip items 4-12), and start the next sub-test.
    • If at least one item is correct and at least one item is incorrect from items 1-3, proceed with the rest of the sub-test (items 4-12).
    • If items 1-3 are all correct, proceed to items 9, 10, 11 and 12 of the sub-test. Then:
      • If items 9-12 are all correct, give credit for items 4-8 of the sub-test (as though they had been answered correctly, gaining a score of 1 for each item).
      • If one of items 9-12 is answered incorrectly, immediately go back and attempt items 4-8 of the sub-test. Then continue to attempt any of items 10-12 not already done.
      Then start the next sub-test.
  • Timeout rule
    A nominal timeout of 5 minutes (300 seconds) applies to each item of this test. After 5 minutes with no response, the twin is automatically taken back to the menu/activity screen. However, the timed out item is not forfeited: on resuming the test, the same item is presented again to the twin. Hence there are no timed out items in the data for this test.

Item Variables

The item variables relating to the Raven's test, as listed in the table below, were generated automatically by programs on the web server during the course of the test. Note that the dataset only includes data for completed tests. If a twin started the test but left it unfinished, then the data for the test were not used.

In most cases the values of these variables have been left unaltered, although some have been recoded during data cleaning as follows. See the web data cleaning page for further details.

  • For items skipped due to the discontinue rule, the item response variable is recoded from missing to -2, and the item score is recoded from missing to 0.
  • For items skipped and credited due to upward branching, the item response variable is recoded from missing to -3 (the item score is already recorded as 1 on the web server).
  • For items that crashed or malfunctioned in any way, the item response variable is recoded from missing to -4, and the item score is recoded from missing to 0.
  • For twins identified as random responders in this test, the status flag is recoded from 2 to 4, the data flag is recoded from 1 to 0, and all item variables are recoded to missing (test data deleted)

The test start and end dates and times, and item answer and download times, and item orders, have not been retained in the dataset.

VariablesExplanationValues
jrstat1/2 Test status: outcome of test 0=not started, 1=started but not finished, 2=successfully completed, 4=random responses
jrdata1/2 Data flag: is test data present in the dataset? 0=no, 1=yes
jrstdt1/2 Start date of the test [not in dataset] Date values
jrsttm1/2 Start time of the test [not in dataset] Time values
jrendd1/2 End date of the test [not in dataset] Date values
jrendt1/2 End time of the test [not in dataset] Time values
jrsess1/2 Number of sessions (at the computer) used by the twin to complete the test. Integer values of 1 or above
jrtime1/2 Time taken to complete the test, in seconds Integer values (number of seconds)
jrXYYa1/2
(where X is the subtest letter a/b/c/d/e and yy is the item number within the subtest, 01-12)
Item response (picture number selected, as tabulated below) 1-6 for sections A and B,
1-8 for sections C, D and E.
Also -2=discontinued, -3=credited due to upward branching, -4=item crashed.
jrXYYs1/2
(where X is the subtest letter a/b/c/d/e and yy is the item number within the subtest, 01-12)
Item score (see table of items below for details) 0=incorrect, 1=correct
jrXYYat1/2
(where X is the subtest letter a/b/c/d/e and yy is the item number within the subtest, 01-12)
Answer time: length of time (in seconds) taken by the twin to respond to this item [not in dataset] Integer values (number of seconds)
jrXYYdt1/2
(where X is the subtest letter a/b/c/d/e and yy is the item number within the subtest, 01-12)
Download time: length of time (in seconds) between the end of the previous item and the start of this item; time needed to download files for this item [not in dataset] Integer values (number of seconds)
jrXYYo1/2
(where X is the subtest letter a/b/c/d/e and yy is the item number within the subtest, 01-12)
Order or sequence of this item in the test; dependent on the branching path taken by the twin through this test [not in dataset] Integer values of 1 or above

Test Items

The numbering of the items, shown in the table below, equates to the numbering used in the item variables. Note that this is not the same as the order in which items were presented to twins in the test (see branching rules above).

itemcorrect responsepicture
A14Ravens test item A1
A25Ravens test item A2
A31Ravens test item A3
A42Ravens test item A4
A56Ravens test item A5
A63Ravens test item A6
A76Ravens test item A7
A82Ravens test item A8
A91Ravens test item A9
A103Ravens test item A10
A114Ravens test item A11
A125Ravens test item A12
B12Ravens test item B1
B26Ravens test item B2
B31Ravens test item B3
B42Ravens test item B4
B51Ravens test item B5
B63Ravens test item B6
B75Ravens test item B7
B86Ravens test item B8
B94Ravens test item B9
B103Ravens test item B10
B114Ravens test item B11
B125Ravens test item B12
C18Ravens test item C1
C22Ravens test item C2
C33Ravens test item C3
C48Ravens test item C4
C57Ravens test item C5
C64Ravens test item C6
C75Ravens test item C7
C81Ravens test item C8
C97Ravens test item C9
C106Ravens test item C10
C111Ravens test item C11
C122Ravens test item C12
D13Ravens test item D1
D24Ravens test item D2
D33Ravens test item D3
D47Ravens test item D4
D58Ravens test item D5
D66Ravens test item D6
D75Ravens test item D7
D84Ravens test item D8
D91Ravens test item D9
D102Ravens test item D10
D115Ravens test item D11
D126Ravens test item D12
E17Ravens test item E1
E26Ravens test item E2
E38Ravens test item E3
E42Ravens test item E4
E51Ravens test item E5
E65Ravens test item E6
E71Ravens test item E7
E86Ravens test item E8
E93Ravens test item E9
E102Ravens test item E10
E114Ravens test item E11
E125Ravens test item E12