AgreeStat
®
360
2 Raters
Contingency Table
2 Columns of Raw Data
3+ Raters
Columns of Raw Scores
Distribution of Raters
Analyzing a Contingency Table
Categories
2
3
4
5
6
7
8
9
10
Execute!
Import data
CSV/Text
Excel
Choose file to upload
Browse...
Separator
Comma
Semicolon
Tab
Quote
None
Double
Single
Reset Input File
Input Ratings
Options
Custom Weights
Output
Load a test dataset
Agreement Coefficients
Cohen's Kappa
Gwet's AC1
Scott's Pi
Krippendorff's Alpha
Brennan-Prediger
Percent Agreement
Weighted Analysis Requested?
Predefined Weights
Custom Weights
Select Set of Weights
Quadratic Weights
Linear Weights
Radical Weights
Simple Ordinal Weights
Ratio Weights
Circular Weights
Bipolar Weights
Benchmarking Method
None
Landis-Koch
Altman
Fleiss
Cumulative Probability Threshold
0.5
0.51
0.52
0.53
0.54
0.55
0.56
0.57
0.58
0.59
0.6
0.61
0.62
0.63
0.64
0.65
0.66
0.67
0.68
0.69
0.7
0.71
0.72
0.73
0.74
0.75
0.76
0.77
0.78
0.79
0.8
0.81
0.82
0.83
0.84
0.85
0.86
0.87
0.88
0.89
0.9
0.91
0.92
0.93
0.94
0.95
0.96
0.97
0.98
0.99
Confidence Level (%):
Sampling Fraction (%):
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
Suply your custom weights here!
Analyzing 2-Rater Raw Scores
Type of Analysis
Chance-corrected Agreement Coefficients (CAC)
Intraclass Correlation Coefficients (ICC)
Subgroup Analysis
Import data?
Execute!
Execute!
CSV/Text
Excel
Choose file to upload
Browse...
Separator
Comma
Semicolon
Tab
Quote
None
Double
Single
Reset Input File
Input Data
Options (CAC)
Options (ICC)
Output
Output
Custom Weights
To subset your data, highlight the target area on the data grid and click the appropriate dark red button
Load a test dataset
Group Data
Header
Target Data
Header
Rater 1 Data
Header
Rater 2 Data
Header
Agreement Coefficients
Cohen's Kappa
Gwet's AC1
Scott's Pi
Krippendorff's Alpha
Brennan-Prediger
Percent Agreement
Weighted Analysis Requested?
Predefined Weights
Custom Weights
Select Set of Weights
Quadratic Weights
Linear Weights
Radical Weights
Simple Ordinal Weights
Ratio Weights
Circular Weights
Bipolar Weights
Benchmarking Method
None
Landis-Koch
Altman
Fleiss
Cumulative Probability Threshold
0.5
0.51
0.52
0.53
0.54
0.55
0.56
0.57
0.58
0.59
0.6
0.61
0.62
0.63
0.64
0.65
0.66
0.67
0.68
0.69
0.7
0.71
0.72
0.73
0.74
0.75
0.76
0.77
0.78
0.79
0.8
0.81
0.82
0.83
0.84
0.85
0.86
0.87
0.88
0.89
0.9
0.91
0.92
0.93
0.94
0.95
0.96
0.97
0.98
0.99
Confidence Level (%):
Sampling Fraction (%):
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
Inter-/Intra-Reliability Model
Each target rated by a different group of raters
Each rater rates a different group of targets
Each rater rates all targets
Specify the nature of the rater effect
Raters from a larger population
Raters are the only ones of interest
Rater/Target Interaction?
Confidence Level (%):
99
95
90
85
80
Type of Intraclass Correlation Coefficient
Inter-Rater Reliability Coefficient
Intra-Rater Reliability Coefficient
Inter-Rater Reliability Coefficient
Intra-Rater Reliability Coefficient
Inter-Rater Reliability Coefficient
Intra-Rater Reliability Coefficient
Suply your custom weights here!
Analyzing Raw Scores for 3 Raters or More
Type of Analysis
Chance-corrected Agreement Coefficients (CAC)
Intraclass Correlation Coefficients (ICC)
Subgroup Analysis
Import data?
Execute!
Execute!
CSV/Text
Excel
Choose file to upload
Browse...
Separator
Comma
Semicolon
Tab
Quote
None
Double
Single
Reset Input File
Input Data
Options (CAC)
Options (ICC)
Output
Output
Custom Weights
To subset your data, highlight the target area on the data grid and click the appropriate dark red button
Load a test dataset
Group Data
Header
Target Data
Header
Input Ratings
Header
Agreement Coefficients
Conger's Kappa
Gwet's AC1
Scott's Pi
Krippendorff's Alpha
Brennan-Prediger
Percent Agreement
Weighted Analysis Requested?
Predefined Weights
Custom Weights
Select Set of Weights
Quadratic Weights
Linear Weights
Radical Weights
Simple Ordinal Weights
Ratio Weights
Circular Weights
Bipolar Weights
Benchmarking Method
None
Landis-Koch
Altman
Fleiss
Cumulative Probability Threshold
0.5
0.51
0.52
0.53
0.54
0.55
0.56
0.57
0.58
0.59
0.6
0.61
0.62
0.63
0.64
0.65
0.66
0.67
0.68
0.69
0.7
0.71
0.72
0.73
0.74
0.75
0.76
0.77
0.78
0.79
0.8
0.81
0.82
0.83
0.84
0.85
0.86
0.87
0.88
0.89
0.9
0.91
0.92
0.93
0.94
0.95
0.96
0.97
0.98
0.99
Confidence Level (%):
Sampling Fraction (%):
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
Inter-/Intra-Rater Reliability Model
Each target rated by a different group of raters
Each rater rates a different group of targets
Each rater rates all targets
Specify the nature of the rater effect
Raters from a larger population
Raters are the only ones of interest
Rater/Target Interaction?
Confidence Level (%):
99
95
90
85
80
Type of Intraclass Correlation Coefficient
Inter-Rater Reliability Coefficient
Intra-Rater Reliability Coefficient
Inter-Rater Reliability Coefficient
Intra-Rater Reliability Coefficient
Inter-Rater Reliability Coefficient
Intra-Rater Reliability Coefficient
Suply your custom weights here!
Analyzing the Distribution of Raters by Subject & Category
Type of Analysis
Chance-corrected Agreement Coefficients (CAC)
Intraclass Correlation Coefficients (ICC)
Subgroup Analysis
Import data?
Execute!
CSV/Text
Excel
Choose file to upload
Browse...
Separator
Comma
Semicolon
Tab
Quote
None
Double
Single
Reset Input File
Input Data
Options (CAC)
Output
Custom Weights
To subset your data, highlight the target area on the data grid and click the appropriate dark red button
Load a test dataset
Group Data
Header
Input Ratings
Header
Agreement Coefficients
Conger's Kappa
Gwet's AC1
Scott's Pi
Krippendorff's Alpha
Brennan-Prediger
Percent Agreement
Weighted Analysis Requested?
Predefined Weights
Custom Weights
Select Set of Weights
Quadratic Weights
Linear Weights
Radical Weights
Simple Ordinal Weights
Ratio Weights
Circular Weights
Bipolar Weights
Benchmarking Method
None
Landis-Koch
Altman
Fleiss
Cumulative Probability Threshold
0.5
0.51
0.52
0.53
0.54
0.55
0.56
0.57
0.58
0.59
0.6
0.61
0.62
0.63
0.64
0.65
0.66
0.67
0.68
0.69
0.7
0.71
0.72
0.73
0.74
0.75
0.76
0.77
0.78
0.79
0.8
0.81
0.82
0.83
0.84
0.85
0.86
0.87
0.88
0.89
0.9
0.91
0.92
0.93
0.94
0.95
0.96
0.97
0.98
0.99
Confidence Level (%):
Sampling Fraction (%):
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
Suply your custom weights here!