Statistics for Premaster CIS endterm
Midterm 35% 26th of March
Endterm 65% 4th of June
Index
Chapter 1 Why do we learn statistics......................................................................................... 4
1.1 On the psychology of statistics......................................................................................... 4
1.2 The cautionary tale of Simpson’s paradox........................................................................4
1.3 Statistics in psychology..................................................................................................... 4
Chapter 2 A brief introduction to research design......................................................................4
2.1 Introduction to psychological measurement.....................................................................4
2.2 Scales of measurement..................................................................................................... 5
2.3 Assessing the reliability of a measurement.......................................................................5
2.4 The ‘role’ of variables: predictors and outcomes..............................................................6
2.5 Experimental and non-experimental research..................................................................6
2.6 Assessing the validity of a study....................................................................................... 6
2.7 Confounders, artefacts and other threats to validity.........................................................7
Chapter 3 Getting started with jamovi....................................................................................... 8
Chapter 4 Descriptive statistics.................................................................................................. 8
4.1 Measures of central tendency........................................................................................... 8
4.2 Measures of variability...................................................................................................... 8
4.3 Skew and kurtosis........................................................................................................... 10
4.4 Descriptive statistics separately for each group.............................................................10
4.5 Standard scores.............................................................................................................. 11
Chapter 5 Drawing graphs........................................................................................................ 11
5.1 Histograms...................................................................................................................... 11
5.2 Boxplots.......................................................................................................................... 11
5.3 Bar graphs....................................................................................................................... 12
Chapter 6 Pragmatic matters (6.2 & 6.4 optional)....................................................................12
6.1 Tabulating and cross-tabulating data..............................................................................12
6.3 Transforming and recoding a variable.............................................................................12
6.5 Extracting a subset of the data....................................................................................... 13
Chapter 7 (optional)................................................................................................................. 13
Chapter 8 Estimating unknown quantities from a sample........................................................13
8.1 Samples, populations and sampling................................................................................13
8.2 The law of large numbers................................................................................................ 14
8.3 Sampling distributions and the central limit theorem.....................................................14
8.4 Estimating population parameters..................................................................................15
8.5 Estimating a confidence interval..................................................................................... 16
,Chapter 9 Hypothesis testing................................................................................................... 16
9.1 A menagerie of hypotheses............................................................................................. 16
9.2 Two types of errors......................................................................................................... 17
9.3 Test statistics and sampling distributions.......................................................................17
9.4 Making decisions............................................................................................................. 18
9.5 The p-value of a test....................................................................................................... 18
9.6 Reporting the results of a hypothesis test.......................................................................19
9.7 Running the hypothesis test in practice..........................................................................19
9.8 Effect size, sample size and power..................................................................................19
9.9 Some issues to consider.................................................................................................. 21
Chapter 11 Comparing two means........................................................................................... 21
11.1 The one-sample z-test................................................................................................... 21
11.2 The one-sample t-test................................................................................................... 22
11.3 The independent samples t-test (Student test).............................................................22
11.4 Completing the test....................................................................................................... 23
11.5 The independent samples t-test (Welch test)................................................................23
11.6 The paired-samples t-test............................................................................................. 24
11.7 One-sided tests............................................................................................................. 24
11.8 Effect size...................................................................................................................... 25
11.9 Checking the normality of a sample.............................................................................. 25
11.10 Testing non-normal data............................................................................................. 26
Chapter 13 Comparing several means (one-way ANOVA)........................................................27
13.2 How ANOVA works........................................................................................................ 27
13.3 Running an ANOVA in jamovi........................................................................................ 28
13.4 Effect size...................................................................................................................... 28
13.5 Multiple comparisons and post hoc tests......................................................................28
13.6 The assumptions of one-way ANOVA............................................................................ 29
13.7 Repeated measures one-way ANOVA............................................................................30
13.8 The Friedman non-parametric repeated measures ANOVA test....................................30
13.9 On the relationship between ANOVA and the Student t-test.........................................30
Chapter 15 (only section 15.5)................................................................................................. 31
15.5 Internal consistency reliability analysis.........................................................................31
Chapter 14 (14.5 & 14.6 optional) Factorial ANOVA.................................................................31
14.1 Factorial ANOVA 1: balanced designs, focus on main effects........................................31
14.2 Factorial ANOVA 2: balanced designs, interpreting interactions...................................32
14.3 Effect size...................................................................................................................... 33
14.4 Assumption checking.................................................................................................... 33
14.7 Different ways to specify contrasts............................................................................... 34
14.8 Post hoc tests................................................................................................................ 35
2
, 14.9 The method of planned comparisons............................................................................35
14.10 Factorial ANOVA 3: unbalanced designs......................................................................35
Chapter 10 Categorical data analysis....................................................................................... 36
10.1 The (chi-square) goodness-of-fit test............................................................................ 36
10.2 The test of independence (or association)....................................................................37
10.3 The continuity correction.............................................................................................. 37
10.4 Effect size...................................................................................................................... 37
10.5 Assumptions of the test(s)............................................................................................ 37
10.6 The Fisher exact test..................................................................................................... 37
10.7 The McNemar test......................................................................................................... 37
Chapter 12 Correlation and linear regression...........................................................................38
12.1 Correlations................................................................................................................... 38
12.2 Scatterplots................................................................................................................... 38
12.3 What is a linear regression model?...............................................................................39
12.4 Estimating a linear regression model............................................................................ 39
12.6 Quantifying the fit of the regression model...................................................................39
12.7 Hypothesis tests for regression models........................................................................39
12.8 Regarding regression coefficients.................................................................................40
12.9 Assumptions of regression............................................................................................ 40
12.10 Model checking........................................................................................................... 40
Practice Units........................................................................................................................... 41
Practice Unit 1....................................................................................................................... 41
Practice Unit 2....................................................................................................................... 42
Practice Unit 3....................................................................................................................... 42
Practice Unit 4....................................................................................................................... 42
Practice Unit 5....................................................................................................................... 44
Practice Unit 6....................................................................................................................... 47
Practice Unit 7&8.................................................................................................................. 48
Practice Unit 9....................................................................................................................... 51
Practice Unit 10..................................................................................................................... 53
Practice Unit 11..................................................................................................................... 54
3
, Chapter 1 Why do we learn statistics
1.1 On the psychology of statistics
Statistics are used because humans are susceptible to biases. Humans find it hard to be neutral, to evaluate evidence
impartially and without being swayed by pre-existing biases.
Belief bias effect = if you ask people to decide whether a particular argument is logically valid (ie. the
conclusion would be true if the premises were true), we tend to be influenced by the believability of the
conclusion, even when we should not.
1.2 The cautionary tale of Simpson’s paradox
Simpson’s paradox = a statistical phenomenon in which a trend appears in several groups of
data, but disappears of or even reverses when the groups are combined. [see image]
However, there are also a lot of (qualitative) questions that statistics cannot answer.
1.3 Statistics in psychology
It’s important to be able to do basic statistics for 3 reasons:
1. Statistics is deeply intertwined with research design. If you want to be good at designing studies, you need to
at the very least understand the basics of stats.
2. You have to be able to understand the literature, including the results of the statistical analyses.
3. You need it in everyday life, for example to understand journalistic articles.
Chapter 2 A brief introduction to research design
2.1 Introduction to psychological measurement
Data collection is a kind of measurement, since we are measuring something about human behavior or the human
mind.
Some thoughts about psychological measurement
Measurement mostly tries to put a number or label to rather abstract ‘stuff’. Some things are easier to measure (eg.
age), however, even this is tricky. Do you measure age in years, or months, or days? Also, what methodology will you
use for this question: self-report (only works for people old enough to understand their age), ask an authoritative
figure, eg. a parent, or rather official records (which is time-consuming).
Operationalization: defining your measurement
Operationalization = the process by which we take a meaningful but somewhat vague concept and turn it into a
precise measurement. This can involve several different things:
1. Being precise about what you are trying to measure.
Eg. age: time since conception, or time since birth.
2. Determining what method you will use to measure it.
Eg. self-report, ask parent, official record.
3. Defining the set of allowable values that the measurement can take.
Eg. years, months, days, hours, etc. or female/male/x/?
This means that operationalization needs to be thought through on a case-by-case basis terminology:
A theoretical construct = the thing you’re trying to take a measurement of (eg. age, gender, etc.). These can’t
be directly observed.
A measure = refers to the method/tool you use to make your observations (eg. question in survey, brain scan,
etc.).
An operationalization = refers to the logical connection between the measure and the theoretical construct,
or the process by which we try to derive a measure from a theoretical construct.
A variable = the actual ‘data’ from the data sets.
4
Midterm 35% 26th of March
Endterm 65% 4th of June
Index
Chapter 1 Why do we learn statistics......................................................................................... 4
1.1 On the psychology of statistics......................................................................................... 4
1.2 The cautionary tale of Simpson’s paradox........................................................................4
1.3 Statistics in psychology..................................................................................................... 4
Chapter 2 A brief introduction to research design......................................................................4
2.1 Introduction to psychological measurement.....................................................................4
2.2 Scales of measurement..................................................................................................... 5
2.3 Assessing the reliability of a measurement.......................................................................5
2.4 The ‘role’ of variables: predictors and outcomes..............................................................6
2.5 Experimental and non-experimental research..................................................................6
2.6 Assessing the validity of a study....................................................................................... 6
2.7 Confounders, artefacts and other threats to validity.........................................................7
Chapter 3 Getting started with jamovi....................................................................................... 8
Chapter 4 Descriptive statistics.................................................................................................. 8
4.1 Measures of central tendency........................................................................................... 8
4.2 Measures of variability...................................................................................................... 8
4.3 Skew and kurtosis........................................................................................................... 10
4.4 Descriptive statistics separately for each group.............................................................10
4.5 Standard scores.............................................................................................................. 11
Chapter 5 Drawing graphs........................................................................................................ 11
5.1 Histograms...................................................................................................................... 11
5.2 Boxplots.......................................................................................................................... 11
5.3 Bar graphs....................................................................................................................... 12
Chapter 6 Pragmatic matters (6.2 & 6.4 optional)....................................................................12
6.1 Tabulating and cross-tabulating data..............................................................................12
6.3 Transforming and recoding a variable.............................................................................12
6.5 Extracting a subset of the data....................................................................................... 13
Chapter 7 (optional)................................................................................................................. 13
Chapter 8 Estimating unknown quantities from a sample........................................................13
8.1 Samples, populations and sampling................................................................................13
8.2 The law of large numbers................................................................................................ 14
8.3 Sampling distributions and the central limit theorem.....................................................14
8.4 Estimating population parameters..................................................................................15
8.5 Estimating a confidence interval..................................................................................... 16
,Chapter 9 Hypothesis testing................................................................................................... 16
9.1 A menagerie of hypotheses............................................................................................. 16
9.2 Two types of errors......................................................................................................... 17
9.3 Test statistics and sampling distributions.......................................................................17
9.4 Making decisions............................................................................................................. 18
9.5 The p-value of a test....................................................................................................... 18
9.6 Reporting the results of a hypothesis test.......................................................................19
9.7 Running the hypothesis test in practice..........................................................................19
9.8 Effect size, sample size and power..................................................................................19
9.9 Some issues to consider.................................................................................................. 21
Chapter 11 Comparing two means........................................................................................... 21
11.1 The one-sample z-test................................................................................................... 21
11.2 The one-sample t-test................................................................................................... 22
11.3 The independent samples t-test (Student test).............................................................22
11.4 Completing the test....................................................................................................... 23
11.5 The independent samples t-test (Welch test)................................................................23
11.6 The paired-samples t-test............................................................................................. 24
11.7 One-sided tests............................................................................................................. 24
11.8 Effect size...................................................................................................................... 25
11.9 Checking the normality of a sample.............................................................................. 25
11.10 Testing non-normal data............................................................................................. 26
Chapter 13 Comparing several means (one-way ANOVA)........................................................27
13.2 How ANOVA works........................................................................................................ 27
13.3 Running an ANOVA in jamovi........................................................................................ 28
13.4 Effect size...................................................................................................................... 28
13.5 Multiple comparisons and post hoc tests......................................................................28
13.6 The assumptions of one-way ANOVA............................................................................ 29
13.7 Repeated measures one-way ANOVA............................................................................30
13.8 The Friedman non-parametric repeated measures ANOVA test....................................30
13.9 On the relationship between ANOVA and the Student t-test.........................................30
Chapter 15 (only section 15.5)................................................................................................. 31
15.5 Internal consistency reliability analysis.........................................................................31
Chapter 14 (14.5 & 14.6 optional) Factorial ANOVA.................................................................31
14.1 Factorial ANOVA 1: balanced designs, focus on main effects........................................31
14.2 Factorial ANOVA 2: balanced designs, interpreting interactions...................................32
14.3 Effect size...................................................................................................................... 33
14.4 Assumption checking.................................................................................................... 33
14.7 Different ways to specify contrasts............................................................................... 34
14.8 Post hoc tests................................................................................................................ 35
2
, 14.9 The method of planned comparisons............................................................................35
14.10 Factorial ANOVA 3: unbalanced designs......................................................................35
Chapter 10 Categorical data analysis....................................................................................... 36
10.1 The (chi-square) goodness-of-fit test............................................................................ 36
10.2 The test of independence (or association)....................................................................37
10.3 The continuity correction.............................................................................................. 37
10.4 Effect size...................................................................................................................... 37
10.5 Assumptions of the test(s)............................................................................................ 37
10.6 The Fisher exact test..................................................................................................... 37
10.7 The McNemar test......................................................................................................... 37
Chapter 12 Correlation and linear regression...........................................................................38
12.1 Correlations................................................................................................................... 38
12.2 Scatterplots................................................................................................................... 38
12.3 What is a linear regression model?...............................................................................39
12.4 Estimating a linear regression model............................................................................ 39
12.6 Quantifying the fit of the regression model...................................................................39
12.7 Hypothesis tests for regression models........................................................................39
12.8 Regarding regression coefficients.................................................................................40
12.9 Assumptions of regression............................................................................................ 40
12.10 Model checking........................................................................................................... 40
Practice Units........................................................................................................................... 41
Practice Unit 1....................................................................................................................... 41
Practice Unit 2....................................................................................................................... 42
Practice Unit 3....................................................................................................................... 42
Practice Unit 4....................................................................................................................... 42
Practice Unit 5....................................................................................................................... 44
Practice Unit 6....................................................................................................................... 47
Practice Unit 7&8.................................................................................................................. 48
Practice Unit 9....................................................................................................................... 51
Practice Unit 10..................................................................................................................... 53
Practice Unit 11..................................................................................................................... 54
3
, Chapter 1 Why do we learn statistics
1.1 On the psychology of statistics
Statistics are used because humans are susceptible to biases. Humans find it hard to be neutral, to evaluate evidence
impartially and without being swayed by pre-existing biases.
Belief bias effect = if you ask people to decide whether a particular argument is logically valid (ie. the
conclusion would be true if the premises were true), we tend to be influenced by the believability of the
conclusion, even when we should not.
1.2 The cautionary tale of Simpson’s paradox
Simpson’s paradox = a statistical phenomenon in which a trend appears in several groups of
data, but disappears of or even reverses when the groups are combined. [see image]
However, there are also a lot of (qualitative) questions that statistics cannot answer.
1.3 Statistics in psychology
It’s important to be able to do basic statistics for 3 reasons:
1. Statistics is deeply intertwined with research design. If you want to be good at designing studies, you need to
at the very least understand the basics of stats.
2. You have to be able to understand the literature, including the results of the statistical analyses.
3. You need it in everyday life, for example to understand journalistic articles.
Chapter 2 A brief introduction to research design
2.1 Introduction to psychological measurement
Data collection is a kind of measurement, since we are measuring something about human behavior or the human
mind.
Some thoughts about psychological measurement
Measurement mostly tries to put a number or label to rather abstract ‘stuff’. Some things are easier to measure (eg.
age), however, even this is tricky. Do you measure age in years, or months, or days? Also, what methodology will you
use for this question: self-report (only works for people old enough to understand their age), ask an authoritative
figure, eg. a parent, or rather official records (which is time-consuming).
Operationalization: defining your measurement
Operationalization = the process by which we take a meaningful but somewhat vague concept and turn it into a
precise measurement. This can involve several different things:
1. Being precise about what you are trying to measure.
Eg. age: time since conception, or time since birth.
2. Determining what method you will use to measure it.
Eg. self-report, ask parent, official record.
3. Defining the set of allowable values that the measurement can take.
Eg. years, months, days, hours, etc. or female/male/x/?
This means that operationalization needs to be thought through on a case-by-case basis terminology:
A theoretical construct = the thing you’re trying to take a measurement of (eg. age, gender, etc.). These can’t
be directly observed.
A measure = refers to the method/tool you use to make your observations (eg. question in survey, brain scan,
etc.).
An operationalization = refers to the logical connection between the measure and the theoretical construct,
or the process by which we try to derive a measure from a theoretical construct.
A variable = the actual ‘data’ from the data sets.
4
