Skip to contents

A simulated oral examination in which each of a candidate's cases is scored by a different examiner on a 0-100 scale. The data are entirely synthetic (generated by [df_simulate()]); no real candidates, examiners or examination are represented. The generating script is in the package's source repository (`data-raw/oral_exam.R`).

Usage

oral_exam

Format

A data frame with 3,600 rows and 4 columns:

candidate

Candidate id.

case

Case id.

examiner

Examiner id.

score

Score on a 0-100 scale (whole points).

Details

300 candidates each take 12 cases. Each case has 8 qualified examiners (48 in all), and each of a candidate's cases is scored by one of them, with no examiner scoring the same candidate twice.

Examples

d <- df_data(oral_exam, person = "candidate", item = "case",
             rater = "examiner", scale = "continuous")
fit <- df_fit(d)
round(fit$par$sigma, 1)                       # residual SD in score points
#> [1] 7.9
head(df_rater_effects(fit))                   # examiner severities (points)
#>   rater   severity
#> 1   E01 -2.0756067
#> 2   E02 -3.2289985
#> 3   E03 -3.8700384
#> 4   E04  1.0323901
#> 5   E05  2.9004364
#> 6   E06 -0.8947828
cf <- df_counterfactual(fit, df_cut(70, "raw_mean"), max_panels = 200, seed = 1)
summary(cf)
#>   decision_rule cut   n pass_rate_observed expected_pass_rate_random_panel
#> 1      raw_mean  70 300               0.65                        0.629042
#>   mean_abs_delta n_rater_dependent n_lenient_panel_pass n_harsh_panel_fail
#> 1     0.04832555                13                    7                  6
#>   n_panel_sensitive
#> 1                82