SmartCane/r_app
DimitraVeropoulou f94a6317bd feat: Integrate 2σ gap filling KPI into weekly field analysis
- Changed gap calculation from Q25 to 2σ below median method (kpi_utils.R)
- Integrated gap filling into script 80 with tile-based processing
- Added Gap_score column to field analysis output (Excel/CSV/RDS)
- Fixed memory issues by processing 25 tiles individually instead of merging
- Fixed Field_id matching to ensure gap scores populate correctly

Gap scores now calculate for all 1185 fields with range 0-11.25%
Works with tile-based mosaics (Angata 5x5 grid) without memory errors
2026-02-03 16:41:04 +01:00
..
experiments Move experimental files to r_app/experiments 2026-01-14 11:07:40 +01:00
old_scripts Move: archive old KPI scripts (09, 09b, 09c, 20) to old_scripts/ for testing 2026-01-14 11:37:13 +01:00
system_architecture Refactor: Update system architecture documentation to reflect Python integration and add complete pipeline overview 2026-01-15 10:25:38 +01:00
.gitignore updated harvest datata stadnadr 2024-03-14 13:00:02 +01:00
10_create_master_grid_and_split_tiffs.R Refactor full pipeline script to include intelligent checking of existing outputs and dynamic execution of scripts. Added new Python scripts for RGB validation and evaluation template creation. Enhanced error handling and logging throughout the pipeline. 2026-01-27 08:58:06 +01:00
20_ci_extraction.R Refactor full pipeline script to include intelligent checking of existing outputs and dynamic execution of scripts. Added new Python scripts for RGB validation and evaluation template creation. Enhanced error handling and logging throughout the pipeline. 2026-01-27 08:58:06 +01:00
20_ci_extraction_utils.R Cleanup: Fix CI formula, reorganize shell scripts and test files 2026-01-14 16:58:51 +01:00
21_convert_ci_rds_to_csv.R Rename: align stage numbering with Bitbucket structure 2026-01-14 11:08:33 +01:00
30_growth_model_utils.R Rename: number utils to match their main scripts 2026-01-14 11:16:23 +01:00
30_interpolate_growth_model.R Refactor full pipeline script to include intelligent checking of existing outputs and dynamic execution of scripts. Added new Python scripts for RGB validation and evaluation template creation. Enhanced error handling and logging throughout the pipeline. 2026-01-27 08:58:06 +01:00
40_mosaic_creation.R working on visualisation, not working too well... 2026-01-18 11:25:31 +01:00
40_mosaic_creation_tile_utils.R Rename: number utils to match their main scripts 2026-01-14 11:16:23 +01:00
40_mosaic_creation_utils.R Enhance harvest detection logic and testing framework 2026-01-15 14:30:54 +01:00
80_calculate_kpis.R feat: Integrate 2σ gap filling KPI into weekly field analysis 2026-02-03 16:41:04 +01:00
80_report_building_utils.R updateing csv file 2026-01-20 12:06:45 +01:00
80_weekly_stats_utils.R updateing csv file 2026-01-20 12:06:45 +01:00
90_CI_report_with_kpis_simple.Rmd Rename: align stage numbering with Bitbucket structure 2026-01-14 11:10:28 +01:00
91_CI_report_with_kpis_Angata.Rmd testing 2026-02-02 11:49:04 +01:00
CI_graph_example.png Add KPI reporting system and deployment documentation 2025-10-14 11:49:30 +02:00
extract_rds_only.R commit all stuff 2026-01-06 14:17:37 +01:00
kpi_utils.R changed the gap_score calculation from using the lower 25% of CI values to excluding pixels eith values 2σ lower than the median. 2026-02-02 13:30:06 +01:00
parameters_project.R Enhance harvest detection logic and testing framework 2026-01-15 14:30:54 +01:00
report_utils.R Cleanup: Fix CI formula, reorganize shell scripts and test files 2026-01-14 16:58:51 +01:00
run_full_pipeline.R Refactor full pipeline script to include intelligent checking of existing outputs and dynamic execution of scripts. Added new Python scripts for RGB validation and evaluation template creation. Enhanced error handling and logging throughout the pipeline. 2026-01-27 08:58:06 +01:00