Aircraft Performance Group

Data Validation Methods

6 September 2013

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. i

TABLE OF CONTENTS
Table of Contents ........................................................................................................................................... i
Table of Figures ............................................................................................................................................. ii
Definitions and Abbreviations ..................................................................................................................... iii
1. Introduction ....................................................................................................................................... 1-1
Through 1-1
2. Regulatory Compliance ...................................................................................................................... 2-1
2.1 Applicable FAA Regulations ....................................................................................................... 2-1
2.2 Applicable Air OPS Regulations .................................................................................................. 2-2
Through 2-2
3. Aircraft Data Digitizing Methods........................................................................................................ 3-1
3.1 SCAP Data Generation ............................................................................................................... 3-1
3.2 Flight Manual Data Generation.................................................................................................. 3-1
3.2.1 Table Data Digitizing Methods ........................................................................................... 3-1
3.2.2 Graphical Data Digitizing Methods .................................................................................... 3-2
Through 3-2
4. Aircraft Data Validation Methods ...................................................................................................... 4-1
4.1 Digitized Data Validation Methods ............................................................................................ 4-1
4.1.1 Tabular Data Validation Methods ...................................................................................... 4-1
4.1.2 Graphical Data Validation Methods ................................................................................... 4-2
4.2 Flight Manual Data Validation Methods .................................................................................... 4-2
4.3 Final Validation Checks .............................................................................................................. 4-3
Through 4-3
5. Conclusion .......................................................................................................................................... 5-1
Through 5-1

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. ii

TABLE OF FIGURES
Figure 1: Flight Manual Tabular Data......................................................................................................... 3-1
Figure 2: Flight Manual Graphical Data ..................................................................................................... 3-2
Figure 3: Tabular Data Graphical Validation .............................................................................................. 4-1

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. iii

DEFINITIONS AND ABBREVIATIONS

 Aircraft Data Sources
o AFM – Aircraft Flight Manual
o SCAP Module – Standard Computerized Airplane Performance Module – A software
program meeting an industry standard used to generate aircraft performance data.
o POH – Pilot Operating Handbook
o QRH – Quick Reference Handbook
 Aircraft Options
o MEL – Minimum Equipment List – APG uses this term to refer to factors applied to
standard AFM data for any systems inoperative conditions
 Regulatory Compliance
o US – United States
o FAA – Federal Aviation Administration
o CFR – Code of Federal Regulations
o EU – European Union
o EC – Commission Regulation

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. 1-1

1. INTRODUCTION
This report documents the methods used by the Aircraft Performance Group (APG) to collect and use
aircraft data from the approved Aircraft Flight Manual or equivalent document. This report will
describe the methods used to digitize the flight manual as well as the validation processes and
acceptance criteria used.

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. 2-1

2. REGULATORY COMPLIANCE
Compliance with aircraft certification requirements is accomplished by the specific aircraft
manufacturers. The approved data is provided through the Airplane Flight Manual (AFM), Pilots
Operating Handbook (POH), Quick Reference Handbook (QRH) or Standard Computerized Airplane
Performance (SCAP) module as appropriate. These documents meet the certification requirements
applicable to the approving authority for the document. The use of the data which APG complies with is
listed in the following regulations.

2.1 Applicable FAA Regulations

The following regulations govern the use of aircraft performance data for US operators.
 14 CFR Part 91 – General Operating and Flight Rules
o §91.1037 – Large transport category airplanes: turbine engine powered; Limitation;
Destination and alternate airports
 14 CFR Part 121 – Operating Requirements: Domestic, Flag, and Supplemental Operations
o §121.175 – Airplanes: Reciprocating engine-powered: Weight limitations
o §121.177 – Airplanes: Reciprocating engine-powered: Takeoff limitations
o §121.185 – Airplanes: Reciprocating engine-powered: Landing limitations: Destination
airport
o §121.187 – Airplanes: Reciprocating engine-powered: Landing limitations: Alternate
airport
o §121.189 – Airplanes: Turbine engine powered: Takeoff limitations
o §121.195 – Airplanes: Turbine engine powered: Landing limitations: Destination airports
o §121.197 – Airplanes: Turbine engine powered: Landing limitations: Alternate airports
o §121.199 – Nontransport category airplanes: Takeoff limitations
o §121.203 – Nontransport category airplanes: Landing limitations: Destination airport
o §121.205 – Nontransport category airplanes: Landing limitations: Alternate airport
 14 CFR Part 135 – Operating Requirements: Commuter and On Demand Operations and Rules
Governing Persons On Board Such Aircraft
o §135.365 – Large transport category airplanes: Reciprocating engine powered: Weight
limitations
o §135.367 – Large transport category airplanes: Reciprocating engine powered: Takeoff
limitations
o §135.375 – Large transport category airplanes: Reciprocating engine powered: Landing
limitations: Destination airports
o §135.377 – Large transport category airplanes: Reciprocating engine powered: Landing
limitations: Alternate airports
o §135.379 – Large transport category airplanes: Turbine engine powered: Takeoff
limitations
o §135.385 – Large transport category airplanes: Turbine engine powered: Landing
limitations: Destination airports
o §135.387 – Large transport category airplanes: Turbine engine powered: Landing
limitations: Alternate airports
o §135.389 – Large nontransport category airplanes: Turbine engine powered: Takeoff
limitations

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. 2-2

o §135.393 – Large nontransport category airplanes: Turbine engine powered: Landing

limitations: Destination airports
o §135.395 – Large nontransport category airplanes: Turbine engine powered: Landing
limitations: Alternate airports
o §135.397 – Small transport category airplane performance operating limitations
o §135.398 – Commuter category airplanes performance operating limitations
o §135.399 – Small nontransport category airplane performance operating limitations

2.2 Applicable Air OPS Regulations

The following regulations govern the use of aircraft performance data for EU operators.
 EC No 965/2012, Annex IV, Subpart C – Commercial air transportation, Aircraft Performance and
Operating Limitations
o Chapter 2 – Performance Class A
 CAT.POL.A.200 – General
 CAT.POL.A.205 – Take-off
 CAT.POL.A.210 – Take-off obstacle clearance
 CAT.POL.A.215(a) – En-route – One engine inoperative
 CAT.POL.A.225 – Landing – Destination and alternate aerodromes
 CAT.POL.A.230 – Landing – Dry runways
 CAT.POL.A.235 – Landing – Wet and contaminated runways
o Chapter 3 – Performance Class B
 CAT.POL.A.305 – Take-off
 CAT.POL.A.325 – Landing – Destination and alternate aerodromes
 CAT.POL.A.330 – Landing – Dry runway
 CAT.POL.A.335 – Landing – Wet and contaminated runways

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. 3-1

3. AIRCRAFT DATA DIGITIZING METHODS

Prior to using aircraft performance data, the data must first be converted to an electronic format. This is
accomplished by using the certified AFM data. Alternatively, equivalent data is used from the
manufacturer SCAP module, checklist and/or QRH, as appropriate.

3.1 SCAP Data Generation

For manufacturers that supply a SCAP module, this data is considered the primary source of aircraft
data. APG uses the SCAP module to generate required takeoff field length, takeoff speeds, climb
gradients, flight path profiles, required landing field length, and landing speeds for a range of conditions.
This data is interpolated for the user specified specific cases to generate the required data as shown in
APG software.

3.2 Flight Manual Data Generation

If the AFM or an equivalent document is used, the data digitizing methods are identical. The data
methods are separated into two categories – table data and graphical data.

3.2.1 Table Data Digitizing Methods

For manuals that have large sections of tabular data, as shown in Figure 1, APG uses a third-party data
entry service. This service uses dual-entry methods and a checking algorithm that compares the two
files for any discrepancies. APG performs additional validation of that data as documented in Section 4.

Figure 1: Flight Manual Tabular Data

For manuals that have small sections of tabular data, APG uses in-house data entry methods. The
validation methods of this data are also documented in Section 4.

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. 3-2

3.2.2 Graphical Data Digitizing Methods

APG uses in-house developed software to digitize graphical data. The pages from the flight manual are
scanned and processed within the software to generate digitized data for use in APG software. The
process for digitizing this data involves identifying the graph boundaries, the applicable granularities of
the graph, and tracing the data curves to export to data files. An example of a completed digitized file is
shown in Figure 2. In this graphic, the computer generated lines are the traced data curves.

Figure 2: Flight Manual Graphical Data

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. 4-1

4. AIRCRAFT DATA VALIDATION METHODS

The data validation methods used by APG include two different levels of checking – validating the
digitized data and validating the use of the digitized data. In all phases, the person(s) performing the
validation are different than the person(s) that performed the digitizing.

4.1 Digitized Data Validation Methods

Validation of digitized data involves different processes for tabular data and graphical data. Both
methods are described here.

4.1.1 Tabular Data Validation Methods

Validation of tabular data is further split into two categories of digitization methods. For data that is
digitized by the third-party data entry service, random checks of the data are performed. For data that
is digitized in-house, every number is validated by a checker that is different than the digitizer. For both
methods, every digitized file is graphed using Microsoft Excel and a visual inspection checks for outliers
in the data. As data tables are by nature two dimensional, both dimensions are graphed. Figure 3
shows an example of graphed tabular data.

Figure 3: Tabular Data Graphical Validation

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. 4-2

4.1.2 Graphical Data Validation Methods

APG’s in-house graphical digitizing tool has a validation mode that is used to check and verify the data.
The validator reloads the scanned image and the extracted curves are loaded onto the image. A visual
inspection identifies any mismatches between the digitized data and the data curves on the image.
Additionally, an automated algorithm looks for data inconsistencies. Automated checks include
misnamed data curves, improper graphical boundaries, duplicated data, and data curves that do not
match the graphical boundaries.

4.2 Flight Manual Data Validation Methods

Prior to releasing completed aircraft performance data to users, additional checks are performed to
validate the values from the software match the performance data from the aircraft flight manual. All
valid aircraft configurations are checked. Configurations can include flap settings, engine bleed options,
power settings, runway conditions, and any MEL or miscellaneous items, as applicable.

The following calculation modes are checked:

 Maximum takeoff weights due to climb limits, brake energy limits and/or tire limits, as
applicable
 Required takeoff field length
 Takeoff speeds V1, VR, V2 and VEnr or VFTO as appropriate
 Takeoff climb gradients
 Takeoff flight path profiles
 Maximum landing weights due to climb limits, brake energy limits and/or tire limits, as
applicable
 Required landing field lengths
 Landing speeds VApp, VRef and VFS
 Landing climb gradients

The validator uses a test program to generate aircraft performance values for specific combinations of
pressure altitude, temperature, wind, runway slope and aircraft configurations and those values are
compared to the aircraft flight manual data. The acceptance criteria are a function of the format of the
data being checked. For tabular data, the resultant aircraft performance values must match the aircraft
flight manual data within 10 feet in the case of distances, 10 pounds in the case of weights and 1 knot in
the case of speeds. For graphical data, the acceptance criteria are a function of the gridline step size of
the graph. For each chart, the acceptance criteria are equal to 25% of the gridline step size. In the case
of graphical flight path profile data, the gridlines can have very large step sizes. In that case, the
distances must match within 1% of the total distance as determined from the charts.

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. 4-3

4.3 Final Validation Checks

Prior to the release of any aircraft performance data to end users, the APG manager of the Engineering
Department runs every possible configuration on target computing hardware. The purpose of this check
is to validate the calculation methods used in the production software match those used in the testing
validation software. All numbers must be an identical match with those generated by the testing
software. Any discrepancies are interrogated and corrected.

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY
 Aircraft Performance Group Aircraft Performance Group Data Validation Methods
4348 Woodlands Blvd., Suite 200 6 September 2013
Castle Rock, CO 80104 p. 5-1

5. CONCLUSION
This report provided an overview of the data collection and validation methods employed by APG. The
data validation methods used by APG include validating the aircraft performance data curves used
match the appropriate certified aircraft performance data from the aircraft manufacturer and the use of
that data generates values that match the certified data.

Copyright © 2013 Aircraft Performance Group. All rights reserved. AIRCRAFT PERFORMANCE GROUP PROPRIETARY