Historical Climate Data Analysis

Date Filtering & Quality Screening

[!TIP] Missing or corrupted periods in a historical record can bias monthly parameter estimates. Use the Date Range Filter to restrict parameter calculation to a selected period of record.

Long-term meteorological stations may span 70 to 100+ years, and earlier decades sometimes contain missing intervals or missing temperature observations. The Date Range Filter restricts analysis and parameter calculation to a specified start and end date.


How to Filter the Date Range

  1. On the CLIGEN parameters tab (or Data analysis tab), locate the Analysis start and Analysis end date pickers.
  2. Select your desired period of record (for example, a 30-year period from 1985-05-01 to 2020-06-08).
  3. Click Generate parameters (or Update parameters).
  4. The application updates the analysis for the selected date range:
  5. Summary statistics update to reflect only the selected date range.
  6. Record completeness and missing-day counts are recalculated for the new window.
  7. Monthly CLIGEN parameters are calculated from the filtered period.

Date Range Filtering and Analysis Period Figure 1: Setting the Analysis Start and Analysis End dates to calculate CLIGEN parameters over a selected period of record.


Data Completeness & Quality Screening

At the top of the historical analysis, the simulator tracks record completeness in real time:

Data Record Completeness and Missing Days Screening Figure 2: Data completeness tracking badge (98.4%) and missing days indicator (168 / 10,559 days).

  • Completeness Metric (Green Badge): Highlights the percentage of valid daily observations. Periods with $\ge 90\%$ completeness appear in green; lower completeness displays an amber caution.
  • Missing Days Counter: Quantifies the exact count of missing observation days out of the total duration.

When Should You Filter the Historical Period?

1. Aligning with Official 30-Year Climate Normals

Meteorological agencies (like NOAA, WMO, and Met Office) update standard climate normals every 10 years (e.g., 1981–2010, 1991–2020). If your environmental permit or site baseline is benchmarked against the 1991–2020 normal, filter your data to start on 1991-01-01 and end on 2020-12-31.

2. Excluding Damaged Gauges or Multi-Month Gaps

If a station experienced a prolonged gauge outage (e.g., an entire missing winter or a multi-year gap due to equipment failure), leaving those missing months in the dataset could falsely lower the calculated monthly precipitation means. Filter the start or end date to exclude the outage.

3. Non-Stationarity and Recent Climate Trends

If a site has experienced shifts in temperature or snowpack over the last 30 years compared to the 1940s, you may wish to calculate parameters from the most recent 30 to 40 years of record rather than the entire 100-year history.


Data Quality Indicators

The system automatically checks for the following data quality issues and displays warnings if detected:

Issue Detection Rule System Action Recommendation
Missing Precipitation Days Gaps in daily rain series Excluded from monthly depth sums; noted in completeness metric If completeness $< 90\%$, adjust date filter to exclude missing years
Negative Precipitation $P < 0$ Flagged and reset to $0.0$ Inspect source file for erroneous negative codes (e.g., -999)
Thermal Inversion Anomaly $T_{\min} > T_{\max}$ Flagged as invalid Correct row in raw spreadsheet or remove corrupted station
Trace Precipitation $0 < P < 0.1\text{ mm}$ ($< 0.01\text{ in}$) Treated as dry for Markov occurrence; depth included in mass balance Standard hydrologic practice