Commit graph

198 commits

Author SHA1 Message Date
DimitraVeropoulou 750db99a41 fixed the KPIs calculation for agronomic utils, fixed the path for saving the excel and rds, updated the main file 2026-02-12 15:43:58 +01:00
DimitraVeropoulou 13015f6ec0 Fix the output path so excel, rds and csv are saved in the same folder 2026-02-12 13:50:57 +01:00
DimitraVeropoulou 7eeed342f3 Update the cane supply main and util script (with the 2σ gap score) 2026-02-12 13:47:35 +01:00
Timon Weitkamp dbc097e42c
Merge pull request #9 from TimonWeitkamp/review_perField_code
Review per field code
2026-02-11 15:11:13 +01:00
Timon bb23e4eca7 Remove obsolete KPI validation and overview maps aggregation scripts 2026-02-11 14:47:39 +01:00
DimitraVeropoulou 613b35fc59 add missing bracket to gap score function 2026-02-11 14:44:09 +01:00
Timon 4cd62ab82e Enhance report utility functions and add validation scripts
- Updated `create_CI_map` and `create_CI_diff_map` functions to enforce a 1:1 aspect ratio for consistent map sizing.
- Modified `ci_plot` function to adjust widths of arranged maps for better layout.
- Changed raster merging method in `aggregate_per_field_mosaics_to_farm_level` from `mosaic` to `merge` for improved handling of field data.
- Introduced `test_kpi_validation.R` script to validate the structure of KPI RDS files, ensuring expected KPIs are present.
- Added `test_overview_maps_aggregation.R` script to test the aggregation pipeline for overview maps, including loading field mosaics, creating a farm-level mosaic, and generating visualizations.
2026-02-11 14:32:36 +01:00
DimitraVeropoulou 97d1ea33f1 add the 2σ calculate_gap_filling_kpi in common utils + comment out old function 2026-02-11 14:03:58 +01:00
DimitraVeropoulou 4968162bfc Add huss in the client type map 2026-02-11 13:31:56 +01:00
Timon b6fa1956c0 Enhance debugging output and improve date handling in TIFF removal script; update report utility functions for better map layout and historical data handling. 2026-02-11 09:48:07 +01:00
Timon 2d6f062c27 changes again 2026-02-10 22:11:58 +01:00
Timon a40b9c1dfe coderabbit fixes 2026-02-10 22:01:02 +01:00
Timon dd83a9e27f some messy updates to script 90, wil l need to do some cleaning tomorrow... 2026-02-10 21:53:49 +01:00
Timon e5a48ca447 remove file 2026-02-10 19:28:49 +01:00
Timon 8de05ce968 modified: r_app/91_CI_report_with_kpis_cane_supply.Rmd 2026-02-10 19:17:12 +01:00
Timon 5ba610d897 Merge remote-tracking branch 'origin/review_perField_code' into code-improvements 2026-02-10 19:13:20 +01:00
Timon 53bfc20f96 Enhance field boundary loading with success flags and improve dummy point handling in hexbin map generation 2026-02-10 17:57:07 +01:00
DimitraVeropoulou 8db2b641ce updated the name of the 90/91 files 2026-02-10 17:52:15 +01:00
Timon 3d3df151d3 Update .gitignore to include cache files, enhance R Markdown report paths, and improve KPI calculation script for clarity and error handling 2026-02-10 17:50:12 +01:00
DimitraVeropoulou cf7d28e276 added missing bracket and added the total acres var in the reports detail 2026-02-10 17:50:08 +01:00
DimitraVeropoulou 4b862bc016 Issue: two variables were in the same line. 2026-02-10 17:46:28 +01:00
Timon f2da320fb6 Refactor KPI calculation scripts for improved error handling and clarity 2026-02-10 16:12:07 +01:00
Timon b1b96e6c6a gap filling worked to per-field 2026-02-10 16:01:59 +01:00
Timon 054cc85bdb small issues 2026-02-10 15:38:23 +01:00
Timon 0dc46628fd Address CodeRabbit review feedback - [description of changes] 2026-02-10 12:45:41 +01:00
Timon 51d479673d Merge branch 'backward-compat-no-tiling' into code-improvements 2026-02-10 12:23:18 +01:00
Timon ede84679d7 code rabbit review stuff 2026-02-10 11:34:29 +01:00
Timon bfd56ccd16 seperate scripts work for angata, except for the word doc. 2026-02-09 20:34:11 +01:00
Timon 3ee3f9e31c shaving off some more details... 2026-02-09 10:40:01 +01:00
DimitraVeropoulou 58d3e655ab
Merge pull request #6 from TimonWeitkamp/SC-119
Sc 119
2026-02-05 14:51:02 +01:00
DimitraVeropoulou 5be79bcc87 Implemented the changed for ISO numbering to 90 script (generated the simple word file) 2026-02-05 12:11:33 +01:00
DimitraVeropoulou cc38d25a54 Changed the week and year numbering to use ISO in the kpi_utils. Update the 80 script to call the function. 2026-02-05 10:54:55 +01:00
Timon Weitkamp db4e8c68e5
Merge pull request #5 from TimonWeitkamp/new_gap_calculation
New gap calculation
2026-02-04 16:41:35 +01:00
DimitraVeropoulou 9f217df98a Changed the generated doc to match the one in Linear (SC-20) BUT i cannot run the coded parts. 2026-02-04 16:24:56 +01:00
Timon e16677eb78 aura until word creation works. word cration itself needs more work. 2026-02-04 12:24:02 +01:00
Timon 5c29c9b549 sc 114 library formatting and cleaning 2026-02-04 09:44:08 +01:00
Timon 85d2f11ed6 issue 113 done, added propper yaml to all files 2026-02-03 17:31:02 +01:00
Timon 8d560ff155 SC-112 Phase 2 Complete: Restructure Script 80 utilities by client type
- Consolidate 80_kpi_utils.R, 80_weekly_stats_utils.R, 80_report_building_utils.R into three client-aware files:
  - 80_utils_common.R (50+ functions): Shared utilities, constants, and helpers
  - 80_utils_agronomic_support.R: AURA-specific KPI calculations (6 KPIs)
  - 80_utils_cane_supply.R: ANGATA placeholder for future expansion
- Move all internal helpers (calculate_cv, calculate_change_percentages, calculate_spatial_autocorrelation, extract_ci_values, etc.) to common
- Add MORAN_THRESHOLD_* constants to common
- Fix parameters_project.R field boundaries path (removed extra 'Data' directory)
- Update 80_calculate_kpis.R with conditional client-type sourcing logic
- Validate both ANGATA (cane_supply) and AURA (agronomic_support) workflows with comprehensive testing
- All 96+ functions accounted for; ready for production use
2026-02-03 17:21:35 +01:00
DimitraVeropoulou f94a6317bd feat: Integrate 2σ gap filling KPI into weekly field analysis
- Changed gap calculation from Q25 to 2σ below median method (kpi_utils.R)
- Integrated gap filling into script 80 with tile-based processing
- Added Gap_score column to field analysis output (Excel/CSV/RDS)
- Fixed memory issues by processing 25 tiles individually instead of merging
- Fixed Field_id matching to ensure gap scores populate correctly

Gap scores now calculate for all 1185 fields with range 0-11.25%
Works with tile-based mosaics (Angata 5x5 grid) without memory errors
2026-02-03 16:41:04 +01:00
Timon 20e3d5b4a3 worked on sc 110 making a 10 utils file and making general log files. 2026-02-03 16:34:49 +01:00
Timon c313f87959 fixed issue 110 moving stuff to 00 common 2026-02-03 16:14:10 +01:00
Timon c4ef10f44f changing paths CS-109 2026-02-03 15:13:21 +01:00
Timon 6efa6b6b05 "wip" 2026-02-03 14:56:04 +01:00
Timon 9e0534cb70 add readme 2026-02-02 15:42:55 +01:00
Timon 86460aa189 table width to page instead of content 2026-02-02 15:37:57 +01:00
Timon 3fe1cf8638 removed emoticons 2026-02-02 15:35:36 +01:00
DimitraVeropoulou 19986706b9 changed the gap_score calculation from using the lower 25% of CI values to excluding pixels eith values 2σ lower than the median. 2026-02-02 13:30:06 +01:00
Timon 14300f6832 updating inbetween stuff, not finished yet 2026-02-02 12:07:10 +01:00
DimitraVeropoulou 39536ab72a testing 2026-02-02 11:49:04 +01:00
Timon 1c08070965 script 40 per-field weekly mosaics - tested with aura 2026-01-29 21:49:15 +01:00