FIREARMS SIMULATION STUDY

STEVE HAWTHORNE and TERRY WOLLERT, Ph.D.

Training Innovation
RODNEY BURNETT and KEVIN ERDMIER
Firearms

26 FLETC JOURNAL | SPRING 2011

 ust about everyone would agree that technology continues to transform how we live – from cell phones that link to the
web, to the laptops and networks that enable us to communicate, work, and even be entertained. The use of technology
and graphic simulation programs can be large in scale, such as multi-million dollar weapon system trainers for military
pilots, to the everyday Xboxes®, PlayStations™, and Wiis™ that entertain us with simulations of military operations,
sports, and rock bands. Since 2007, the Federal Law Enforcement Training Center (FLETC) has been using technology
to enhance student learning through the use of driving and marine simulators. More recently, the Avatar Based Interview
Simulator (ABIS) is being studied as a viable training tool for teaching students to conduct an interview using the
five-step process they are taught in class. Even the Firearms Division (FAD) uses laser handguns and branching videos
to teach the Judgment Pistol Shooting Course. Most recently, the FLETC explored using simulation to teach basic
marksmanship shooting skills by conducting a Firearms Simulation study.

FLETC JOURNAL | SPRING 2011 27

 ...a major
advantage over
YLN\SHYKY`ÄYLPZ
that the Laser Shot
system provides
immediate
feedback as to
shot placement.

FLETC marksmanship instructors coach basic students using the Laser Shot simulation laser handgun
during the Firearms Simulation Study.

AT THE FLETC a basic student’s Next, the TID and FAD began laser insert that would fire an invisible
first exposure to the use of handguns looking at various styles of handguns. infrared laser each time the trigger
is in the Basic Marksmanship Essentially, there are two styles of was pressed. Therefore, the basics
Instruction (BMI) course. BMI handguns available; those with recoil of stance, grip, sight alignment, and
includes basic weapons handling and those without recoil. Research by trigger control would be similar to
skills, including stance, grip, sight the U.S. Army indicates that recoil is dry firing a real weapon. However, a
alignment, and trigger control. So, not necessarily required to teach Basic major advantage over regular dry fire
in partnership with the FAD, the Marksmanship (Smith & Hagman, is that the Laser Shot system provides
Training Innovation Division (TID) 2000). Other research has found that immediate feedback as to shot
began looking at various Firearms though the technology of simulating placement.
simulators for the study. recoil has advanced, it’s not always Though basic students enrolled in
One such simulator is Laser Shot’s reliable, and can actually hinder the Criminal Investigator Training
“FLETC Course of Fire.” As an training (Grant & Galanis, 2009). This Program (CITP) start out in BMI,
enterprise supplier at FLETC, Laser is especially true when using a system their real goal is to shoot a qualifying
Shot products are used by the FAD in which requires the weapon to be score at the end of the Semiautomatic
the Judgment Pistol Shooting Course tethered to a canister that is attached Pistol Course (SPC). After attending
and by the Driver Marine Division to the shooters belt and supplies BMI, students receive 18 hours of
(DMD) in marine boat boarding the carbon dioxide gas necessary to SPC instruction. At the end, students
training. Laser Shot’s “FLETC simulate recoil. Untethered systems, shoot the FLETC SPC Course of
Course of Fire” accurately simulates which incorporate carbon dioxide Fire and must achieve a qualifying
what a real range looks like, including gas canisters into the magazine are score of 210 out of 300 possible
targets that move, turn, and face for available; but at this time, they are also points. Therefore, the real question to
specific time intervals. In addition, cost prohibitive. be answered is whether or not the final
Laser Shot’s “FLETC Course of Fire” Based on these findings, TID qualifying SPC score of those using a
can display practically any target while decided to first conduct research using laser handgun in BMI is significantly
accurately simulating target size at a handgun without recoil. Specifically, different from the final qualifying
various distances. Finally, the Laser TID, in concert with FAD, decided SPC score of those using a live-fire
Shot “FLETC Course of Fire” can to use a Glock 17 R with a resetting handgun in BMI.
easily be set up in a large classroom. trigger. Each Glock was fitted with a To answer this question, TID

28 FLETC JOURNAL | SPRING 2011

 ...14 college
students initially
volunteered
to participate.
Students were then
Z[YH[PÄLKIHZLKVU
criteria including
age, gender, and
prior experience
CHART 1
with a handgun.

approached the College of Coastal score for those college students USMS CITP students were stratified
Georgia (CCGA) about allowing who trained in BMI with a laser into groups based on age, gender, and
college students to participate in weapon was 257.8. The average SPC prior Law Enforcement or Military
the Firearms Simulation Study. qualifying score for those who trained experience which included training
Once approved, TID staff and FAD in BMI with a live-fire weapon was on the use of a handgun. The students
instructors met with CCGA students 260.4. Average scores for each group were then randomly assigned to either
majoring in Criminal Justice. As a beginning with SPC-4 are shown in train in BMI with a laser handgun or
result, 14 college students initially Chart 1, above. with a live-fire Glock 22 .40 caliber
volunteered to participate. Students Though there was only a 2.6 point handgun. Specific demographics for
were then stratified based on criteria difference, 14 participants were not each group are shown in Table 1, page
including age, gender, and prior enough to draw a conclusion about 30.
experience with a handgun. The whether or not the difference was As with the college students,
students were then randomly assigned statistically insignificant. However, all instruction was conducted in
to one of two groups, those who the results were strong enough to accordance with FAD BMI and SPC
would use a laser handgun in BMI, suggest that the FAD and TID staff lesson plans. Rod Burnett and Kevin
and those who would use a live-fire approach Partner Organizations about Erdmier served as the lead instructors
handgun in BMI. All instruction was allowing their students to participate with FAD staff providing all class and
conducted in accordance with FAD in the study. (To that end, the FAD line instruction. Given that these were
lessons plans and by FAD instructors. and TID want to thank the United regularly scheduled training sessions,
After completing BMI, all students States Marshals Service (USMS) for the full 18 hours of SPC instruction
participated in the FLETC SPC volunteering three classes of their was provided using the Glock 22.
course of fire. students enrolled in the Criminal Those who used a laser weapon
Due to the time constraints of Investigator Training Program (CITP) during BMI training shot a SPC
the CCGA semester system, SPC to participate in the study.) This average qualifying score of 275.8.
instruction was limited to only 14 allowed for a total of 140 students to Those who used a live-fire weapon
hours rather than the normal 18 hours. be assigned to either BMI using a laser during BMI training shot a SPC
After completing SPC instruction, handgun or to BMI using a live-fire average qualifying score of 278.2.
students shot a final qualification weapon. An independent t-test found
round. The average SPC qualifying As with the college students, the this difference to be statistically

FLETC JOURNAL | SPRING 2011 29

insignificant. Average scores for each of 282.5 for those who trained with statistical differences were found. All
group during the last seven SPC a live-fire handgun. These differences students in the study group who “Did
sessions are shown in Chart 2, below. were also statistically insignificant. Not Qualify” were provided with four
To determine if the students in the Those with no prior military and/or hours of live-fire handgun training
research study performed differently law enforcement firearms training who on BMI; subsequently, they shot a
than students who receive routine trained with a laser handgun in BMI qualifying score during the reshoot.
firearms training, data was compared shot an average SPC qualifying score As mentioned before, all training
to the three previous USMS CITP of 265.0 compared to an average SPC was done in accordance with the
SPC classes. These USMS CITP qualifying score of 266.8 for those applicable lesson plans. However,
classes were used as the control group. who trained with a live-fire handgun those training with the laser handguns
In total, 138 students in prior classes in BMI. Again, these differences were during BMI did not need to wear
who trained with a live-fire handgun statistically insignificant. These results hearing protection. This allowed
in BMI shot a SPC average qualifying are presented in Table 3, page 31. instructors to carry on normal
score of 275.8. This is the same Based on the score a student shoots, conversations while instructing
average as those who trained with a they are given one of five possible students in the proper stance, grip,
laser handgun in BMI. Data analysis classifications. Scores below 210 sight alignment, and trigger control.
indicated that differences between the are classified as “Did Not Qualify,” Students could freely ask questions
control group and the study group scores from 210 to 254 are classified and get answers without having to
were statistically insignificant. See as “Marksman,” scores from 255 to “yell” or “read lips.” One instructor
Table 2 below for a summary of SPC 284 are classified as “Sharp Shooter,” commented that because he could
qualification scores. scores from 285 to 299 are classified get “up close and personal,” he was
The students with prior military as “Expert,” and a score of 300 is able to see errors in weapon handling,
and/or law enforcement firearms classified as “Distinguished Expert.” especially in respect to grip and trigger
training who trained with a laser Results by category are shown in press, that he would not have normally
handgun in BMI shot an average SPC Table 4, page 31. Though there is some been able to see.
qualifying score of 280.1 compared variation within each classification, Other benefits include both a
to an average SPC qualifying score based on the BMI training method, no reduction in ammunition usage,

Firearms Study Participation Demographics

BMI Training Group Average No Prior Prior Experience
Males Females
Method Size Age Experience (Military or LE)
Laser 70 29 59 11 20 50
Live-Fire 70 30 61 9 19 51
TABLE 1

SPC Qualification Scores

BMI Training Study USMS CITP
Method Group Control Group
Laser 275.8 N/A
Live-Fire 278.2 275.8
TABLE 2

CHART 2

30 FLETC JOURNAL | SPRING 2011

 A FLETC marksmanship instructor
helps a student correct shooting
position and alignment during the
Firearms Simulation Study.

accompanying cost savings associated a weapon malfunction that can be replace actual live-fire or “putting
with range maintenance, and in freeing cleared by the “Primary Immediate rounds down range.” However, several
up valuable range time. This additional Action” procedure and emergency studies, to include the FLETC
range time could then be used to teach reloads. However, even the best Live-Fire/Simulation Study, seem to
more advanced live-fire courses and/ simulated weapon with recoil cannot indicate that firearm simulation is a
or increase the through-put of basic simulate the concussion blast of a viable approach to certain introductory
training classes. Furthermore, since live-fire handgun. Still, future research phases of marksmanship training and
BMI using a laser handgun can be should be designed to incorporate is on the verge of becoming a valuable
taught in a large classroom, those simulated recoil and should seek to tool in both the teaching and learning
without an indoor range can still train partner with other agencies in order to of psychomotor skills.
no matter what the weather conditions evaluate the success rate with the full
might be outside. range of FLETC students.
If a laser handgun is to accurately In conclusion, it does appear that
simulate a live-fire handgun, the the CCGA students and the USMS
-Grant, S. C., & Galanis, G. (2009). Assessment
impact of recoil must be considered. CITP students training with a non- and prediction of effectiveness of virtual
As mentioned before, there are recoil laser handgun in BMI achieve environments: Lessons learned from small
recoil systems that incorporate statistically similar SPC qualification arms simulation. In Cohn, J. & Nicholson, D. &
carbon dioxide gas cylinders into the scores that students training with a Schmorrow, D. (Ed.) The PSI Handbook of Virtual
Environments for Training and Education, Volume
magazine. When the trigger is pressed, live-fire weapon achieve. In addition 3, Integrated systems, Training Evaluation, and
gas is released causing the slide to to the potential cost savings, laser Future Directions, Westport, CT.
operate. This also forces a student to handgun BMI training offers several -Smith, M., & Hagman, J. (2000). Predicting
5LÁHDQG3LVWRO0DUNVPDQVKLSSHUIRUPDQFHZLWK
reacquire their sights. Some of the instructional advantages and also the Laser Marksmanship Training System (Tech.
more advanced simulated handguns provides a safer environment than Rep. 1106). Alexandria, VA: U.S. Army Research
can even be programmed to simulate live-fire. In the end, nothing will ever Institute for the Behavioral Sciences.

BMI Training 3 Prior CITP

Method Classes
SPC Classification Laser Live-fire Live-fire
SPC Qualification Scores
Did Not Qualify 2.9% 0% 0.7%
BMI Training No Prior Prior Experience
Method Experience (Military or LE) Marksmanship 10.0% 7.1% 10.9%
Laser 265.0 280.1 Sharp Shooter 48.6% 47.1% 50.8%
Live-Fire 266.8 282.5 Expert 34.3% 37.1% 35.5%
TABLE 3 Distinguished Expert 4.3% 8.6% 2.2%
TABLE 4

FLETC JOURNAL | SPRING 2011 31

 PARK SERVICE regulations established expressly work in them. The role of the
continued from page 16 for the protection of our national park ranger has evolved over
parks are contained within Title 16 time…first created to protect
time and maximize of the U.S. Code and Title 36 of and watch over these American
on-the-water boat the Code of Federal Regulations treasures…now park rangers
operations. (CFR). Many parks have conduct duties not too unlike those
FLETC promulgated their own special of a city patrolman, responding
Advanced regulations designed specifically to to domestic disputes, drunk and
Training Programs. NPS-LETC protect certain features particular disorderly calls, Driving Under
coordinates access for park rangers to that one park. Park rangers the Influence, gang related crimes,
to the FLETC advanced training can enforce all federal law within drug smuggling, etc. The park
programs, ranging from physical the jurisdictional boundaries of ranger’s duties are as diverse and
security, firearms instructor, driver the park. In addition, the NPS range from structural and wildland
instructor, to advanced computer has entered into Memorandums firefighter, to mountain climber, ski
forensics and crime scene of Understanding with other patrol, horseback riding, high angle
management. land management agencies and rescue, search and rescue, boat
The Ranger Honor Guard. The cross-designate law enforcement patrol, river rescue, EMS, SCUBA
coordination and deployment personnel to assist each other diver, wildlife management,
of the distinct 18 member NPS with routine and emergency law cave explorer, archeologist,
Ranger Honor Guard is the enforcement situations. State geologist, paleontologist, biologist,
responsibility of the Advanced law is also enforced within the campground manager, fee collector,
Program Manager. The national parks through the use of pilot, and airboat operator, just
Ranger Honor Guard comes the Assimilative Crimes Act and to name a few. The U.S. Park
to the FLETC to train for this adoption process with 36 CFR. Ranger position encompasses
prestigious duty. Many park rangers are also either perhaps more diverse functions
In addition to protecting the deputized within the states that and responsibilities than any other
scenic and natural features of our the park resides, or possess state job within the federal government.
park lands, the park ranger also law enforcement powers through The Federal Law Enforcement
protects the cultural and historical state statutory provisions. Training Center and the NPS
features of these lands by enforcing Our 392 national parks stretch Law Enforcement Training
the laws specifically established to from all 4 corners of the United Center form a crucial partnership
protect these valuable resources. States and nearly everywhere in in providing the essential law
The Antiquities Act of 1906 was a between. From Acadia National enforcement training our park
legislative landmark that set aside Park in Maine to Everglades rangers need today to perform
and protected historic landmarks, National Park is south Florida; their jobs in our national parks.
historic and prehistoric structures from Organ Pipe Cactus National
and other objects of historic or Monument in southern Arizona Charles R. “Butch” Farabee Jr. (2003).
scientific interest. Furthermore, in to Olympic National Park in National Park Ranger: An American Icon.
Roberts Rinehart Publishers.
1979 the Archeological Resource Northwest Washington State; Paul D. Berkowitz. (1995). U.S. Rangers.
Protection Act was established to with parks established in San Juan, The Law of the Land. The History of
protect the ancient and historic Puerto Rico, Hawaii, American Law Enforcement in the Federal Land
Management Agencies. CT Publishing
remains of cultures on federal and Samoa, Guam and Alaska, our Company.
Native American lands. national parks cover every state in William R. Supernaugh. (1998). Enigmatic
the union except one, Delaware. Icon: The Life and Times of Harry Yount.
The overlapping laws of Annals of Wyoming: The Wyoming History
jurisdiction within the National Our parks are as diverse and Journal, Spring 1998, Vol. 70. No. 2.
Parks: The Federal laws and unique as the park rangers who Wyoming State Historical Society.

32 FLETC JOURNAL | SPRING 2011