Date Filtering & Quality Screening
[!TIP] Missing or corrupted periods in a historical record can bias monthly parameter estimates. Use the Date Range Filter to restrict parameter calculation to a selected period of record.
Long-term meteorological stations may span 70 to 100+ years, and earlier decades sometimes contain missing intervals or missing temperature observations. The Date Range Filter restricts analysis and parameter calculation to a specified start and end date.
How to Filter the Date Range
- On the CLIGEN parameters tab (or Data analysis tab), locate the Analysis start and Analysis end date pickers.
- Select your desired period of record (for example, a 30-year period from
1985-05-01to2020-06-08). - Click Generate parameters (or Update parameters).
- The application updates the analysis for the selected date range:
- Summary statistics update to reflect only the selected date range.
- Record completeness and missing-day counts are recalculated for the new window.
- Monthly CLIGEN parameters are calculated from the filtered period.
Figure 1: Setting the Analysis Start and Analysis End dates to calculate CLIGEN parameters over a selected period of record.
Data Completeness & Quality Screening
At the top of the historical analysis, the simulator tracks record completeness in real time:
Figure 2: Data completeness tracking badge (98.4%) and missing days indicator (168 / 10,559 days).
- Completeness Metric (Green Badge): Highlights the percentage of valid daily observations. Periods with $\ge 90\%$ completeness appear in green; lower completeness displays an amber caution.
- Missing Days Counter: Quantifies the exact count of missing observation days out of the total duration.
When Should You Filter the Historical Period?
1. Aligning with Official 30-Year Climate Normals
Meteorological agencies (like NOAA, WMO, and Met Office) update standard climate normals every 10 years (e.g., 1981–2010, 1991–2020). If your environmental permit or site baseline is benchmarked against the 1991–2020 normal, filter your data to start on 1991-01-01 and end on 2020-12-31.
2. Excluding Damaged Gauges or Multi-Month Gaps
If a station experienced a prolonged gauge outage (e.g., an entire missing winter or a multi-year gap due to equipment failure), leaving those missing months in the dataset could falsely lower the calculated monthly precipitation means. Filter the start or end date to exclude the outage.
3. Non-Stationarity and Recent Climate Trends
If a site has experienced shifts in temperature or snowpack over the last 30 years compared to the 1940s, you may wish to calculate parameters from the most recent 30 to 40 years of record rather than the entire 100-year history.
Data Quality Indicators
The system automatically checks for the following data quality issues and displays warnings if detected:
| Issue | Detection Rule | System Action | Recommendation |
|---|---|---|---|
| Missing Precipitation Days | Gaps in daily rain series | Excluded from monthly depth sums; noted in completeness metric | If completeness $< 90\%$, adjust date filter to exclude missing years |
| Negative Precipitation | $P < 0$ | Flagged and reset to $0.0$ | Inspect source file for erroneous negative codes (e.g., -999) |
| Thermal Inversion Anomaly | $T_{\min} > T_{\max}$ | Flagged as invalid | Correct row in raw spreadsheet or remove corrupted station |
| Trace Precipitation | $0 < P < 0.1\text{ mm}$ ($< 0.01\text{ in}$) | Treated as dry for Markov occurrence; depth included in mass balance | Standard hydrologic practice |