A simulated oral examination in which each of a candidate's cases is scored by a different examiner on a 0-100 scale. The data are entirely synthetic (generated by [df_simulate()]); no real candidates, examiners or examination are represented. The generating script is in the package's source repository (`data-raw/oral_exam.R`).
Format
A data frame with 3,600 rows and 4 columns:
- candidate
Candidate id.
- case
Case id.
- examiner
Examiner id.
- score
Score on a 0-100 scale (whole points).
Details
300 candidates each take 12 cases. Each case has 8 qualified examiners (48 in all), and each of a candidate's cases is scored by one of them, with no examiner scoring the same candidate twice.
Examples
d <- df_data(oral_exam, person = "candidate", item = "case",
rater = "examiner", scale = "continuous")
fit <- df_fit(d)
round(fit$par$sigma, 1) # residual SD in score points
#> [1] 7.9
head(df_rater_effects(fit)) # examiner severities (points)
#> rater severity
#> 1 E01 -2.0756067
#> 2 E02 -3.2289985
#> 3 E03 -3.8700384
#> 4 E04 1.0323901
#> 5 E05 2.9004364
#> 6 E06 -0.8947828
cf <- df_counterfactual(fit, df_cut(70, "raw_mean"), max_panels = 200, seed = 1)
summary(cf)
#> decision_rule cut n pass_rate_observed expected_pass_rate_random_panel
#> 1 raw_mean 70 300 0.65 0.629042
#> mean_abs_delta n_rater_dependent n_lenient_panel_pass n_harsh_panel_fail
#> 1 0.04832555 13 7 6
#> n_panel_sensitive
#> 1 82