WTI

Evaluation of Montana's "New Entrant Safety Assurance Program"

Primary Investigator Contact Information

External Project Contact(s)

Report(s)

1. Evaluation of Montana's New Entrant Safety Assurance Program: Phase I
   1. Michael Cole
   2. 4W0735_PhaseI_Report.pdf

Project Objective

To provide an independent evaluation of the effectiveness of Montana’s “New Entrant Safety Assurance Program” and suggest ways to improve the program.

Project Abstract

The state of Montana is implementing a five-year pilot program that provides safety training for new interstate motor carriers. The “New Entrant Safety Assurance Program” will use a third-party contractor to educate the commercial drivers about applicable safety laws and regulations prior to the mandatory state-run Safety Audit. Over the course of the five-year program, WTI will conduct an evaluation to assess the effectiveness of the training program in areas such as compliance with safety laws and regulations, long-term accident rates, and pass rates for the official Safety Audit.

Task Descriptions

1. Project management
   1. Task 2.1: Analyze percentage of new carrier entrants using the new program – Use MCSAP databases to determine new carrier participation rates. Task 2.2: Evaluate time commitments required of each stakeholder – Use time studies and informal surveys to evaluate time required of each stakeholder, including new carriers, MCSAP, and the State of Montana. Task 2.3: Evaluate pass/fail rate of safety pre-audits – Collect data and determine high/low results, differences between “students” and detect trends. Task 2.4: Evaluate pass/fail rate of official safety audits – Query MCSAP databases to compare safety audit results of participants and non-participants. Task 2.5: Collect safety data and out-of-service data for participants and non-participants – Query MCSAP databases to compare out-of-service rate of participants and non-participants. Task 2.6: Determine preliminary overall effectiveness from MCSAP point of view – Program effectiveness will be determined based on performance measures developed in Task 1.6. Task 2.7: Determine preliminary overall effectiveness from carrier point of view – Program effectiveness will be determined based on performance measures developed in Task 1.6. Task 2.8: Document Phase 2 in a technical report – Deliver a report that collects and summarizes all previous reports in this phase.
2. Project Management
   1. Task 1.1: Summarize current process and (preliminary) proposed processes – Sketch existing and proposed processes in enough detail to sufficiently “train” future project members. Task 1.2: Review related government programs – Related programs that may exist in other states or Canadian provinces will be reviewed. Task 1.3: Review scholarly literature related to transportation – Examine and report on journal articles and conference papers related to carrier safety, safety audits, and transportation training. Task 1.4: Review scholarly literature related to program assessment -- A report summarizing literature that is devoted to assessment of education and training programs will be produced. Task 1.5: Develop program policy for carrier confidentiality – A policy to manage the confidentiality of carriers who participate in the safety audit training will be developed by examining existing related policies and informally surveying carriers. Task 1.6: Develop program outcomes/objectives, performance measures, and measurement instruments – Outcomes will measure results immediately upon completion of the training; objectives will measure results about five years after that. Task 1.7: Collect data on existing process – Collect safety information from existing MCSAP databases and conduct time studies of official safety audits. Task 1.8: Assist contractor in development of new training program – Work with contractor to assure that the new training program is compatible with performance measures developed in Task 1.6. Task 1.9: Document Phase 1 in a technical report – Issue a report that collects and summarizes all previous reports in this phase.
3. Project management
   1. Task 3.1 – 3.7 – Repeat Tasks 2.1-2.7 for the overall five-year pilot program. Task 3.8: Assess training program and suggest changes – Prepare a report that provides an overall assessment of the training program’s success and suggestions for improvement. Task 3.9: Develop “tech transfer templates” so the program can be used by other states – A report and manual will be created that can be shared with other MCSAP districts. Task 3.10: Document Phase 3 in a technical report – Deliver a report that collects and summarizes all previous reports in this phase.

Milestones, Dates, Schedule

Student Involvement

False

Relationship to Other Research Projects

False

Technology Transfer Activities

True

TRB Keywords

Safety audit, interstate motor carriers, motor carrier driver safety

Partners

Montana Highway Patrol, The West Yellowstone Group