Rough-out of Methodology

Here's a rough draft of my proposed research methodology:

Design: Within-group (Interrupted Time Series) Experimental (not randomly assigned, one group, one or more interventions, dependent variables measured/observed after each intervention, group becomes its own control). Permits significant control over threats to internal validity such as history, maturation of participants, statistical regression, and selection and treatment.

Independent variable: application of quality management principles/procedures to instructional design/development effort

Dependent variables:

1.       Production metrics (errors made in development, found in internal and external quality control/quality assurance reviews) compared before and after ISO:9000 registration
2.       Instruction metrics (test scores, graduation data) compared before and after ISO:9000 registration

Meta-analysis of Quality Management System (QMS) compared to instructional design theory/process found in ADDIE (not a variable, per se)

Descriptive statistics: average number of errors per number of layers in internal qc/qa reviews; average number of errors per number of layers in external qc/qa reviews; compare before and after registration. Mean only? Are mode and median relevant? Can they be ascertained? What about variance, standard deviation, and range? Do a practice analysis.

Inferential statistics:  ANOVA using t-test statistic for each dependent variable separately and two-way ANOVA using x² statistic comparing both dependent variables together against the independent variable. Software: SPSS