Commit graph

203 commits

Author SHA1 Message Date
DimitraVeropoulou a9840171cb Enhance logging functionality and update report generation scripts
- Improved safe_log function to include timestamps and conditional logging
- Added diagnostic messages for field visualization processing
- Updated CI map rendering parameters for consistency
- Refined raster mapping functions in report_utils for clarity
- Added .png files to .gitignore
2026-02-16 10:21:55 +01:00
DimitraVeropoulou 684050d459 fixed the "key insights" calculation 2026-02-12 17:27:21 +01:00
DimitraVeropoulou eb1b7772e5 changed the named of the generated excel and rmd back to "kpi_summary_tables_week", as the 90 requests 2026-02-12 17:16:41 +01:00
DimitraVeropoulou 3106871a81 Remove the creation of weekly_tile_max_mosaic folder 2026-02-12 16:55:34 +01:00
DimitraVeropoulou be29e4fcb3 round to 2 decimals the gap score 2026-02-12 15:44:41 +01:00
DimitraVeropoulou 750db99a41 fixed the KPIs calculation for agronomic utils, fixed the path for saving the excel and rds, updated the main file 2026-02-12 15:43:58 +01:00
DimitraVeropoulou 13015f6ec0 Fix the output path so excel, rds and csv are saved in the same folder 2026-02-12 13:50:57 +01:00
DimitraVeropoulou 7eeed342f3 Update the cane supply main and util script (with the 2σ gap score) 2026-02-12 13:47:35 +01:00
Timon Weitkamp dbc097e42c
Merge pull request #9 from TimonWeitkamp/review_perField_code
Review per field code
2026-02-11 15:11:13 +01:00
Timon bb23e4eca7 Remove obsolete KPI validation and overview maps aggregation scripts 2026-02-11 14:47:39 +01:00
DimitraVeropoulou 613b35fc59 add missing bracket to gap score function 2026-02-11 14:44:09 +01:00
Timon 4cd62ab82e Enhance report utility functions and add validation scripts
- Updated `create_CI_map` and `create_CI_diff_map` functions to enforce a 1:1 aspect ratio for consistent map sizing.
- Modified `ci_plot` function to adjust widths of arranged maps for better layout.
- Changed raster merging method in `aggregate_per_field_mosaics_to_farm_level` from `mosaic` to `merge` for improved handling of field data.
- Introduced `test_kpi_validation.R` script to validate the structure of KPI RDS files, ensuring expected KPIs are present.
- Added `test_overview_maps_aggregation.R` script to test the aggregation pipeline for overview maps, including loading field mosaics, creating a farm-level mosaic, and generating visualizations.
2026-02-11 14:32:36 +01:00
DimitraVeropoulou 97d1ea33f1 add the 2σ calculate_gap_filling_kpi in common utils + comment out old function 2026-02-11 14:03:58 +01:00
DimitraVeropoulou 4968162bfc Add huss in the client type map 2026-02-11 13:31:56 +01:00
Timon b6fa1956c0 Enhance debugging output and improve date handling in TIFF removal script; update report utility functions for better map layout and historical data handling. 2026-02-11 09:48:07 +01:00
Timon 2d6f062c27 changes again 2026-02-10 22:11:58 +01:00
Timon a40b9c1dfe coderabbit fixes 2026-02-10 22:01:02 +01:00
Timon dd83a9e27f some messy updates to script 90, wil l need to do some cleaning tomorrow... 2026-02-10 21:53:49 +01:00
Timon e5a48ca447 remove file 2026-02-10 19:28:49 +01:00
Timon 8de05ce968 modified: r_app/91_CI_report_with_kpis_cane_supply.Rmd 2026-02-10 19:17:12 +01:00
Timon 5ba610d897 Merge remote-tracking branch 'origin/review_perField_code' into code-improvements 2026-02-10 19:13:20 +01:00
Timon 53bfc20f96 Enhance field boundary loading with success flags and improve dummy point handling in hexbin map generation 2026-02-10 17:57:07 +01:00
DimitraVeropoulou 8db2b641ce updated the name of the 90/91 files 2026-02-10 17:52:15 +01:00
Timon 3d3df151d3 Update .gitignore to include cache files, enhance R Markdown report paths, and improve KPI calculation script for clarity and error handling 2026-02-10 17:50:12 +01:00
DimitraVeropoulou cf7d28e276 added missing bracket and added the total acres var in the reports detail 2026-02-10 17:50:08 +01:00
DimitraVeropoulou 4b862bc016 Issue: two variables were in the same line. 2026-02-10 17:46:28 +01:00
Timon f2da320fb6 Refactor KPI calculation scripts for improved error handling and clarity 2026-02-10 16:12:07 +01:00
Timon b1b96e6c6a gap filling worked to per-field 2026-02-10 16:01:59 +01:00
Timon 054cc85bdb small issues 2026-02-10 15:38:23 +01:00
Timon 0dc46628fd Address CodeRabbit review feedback - [description of changes] 2026-02-10 12:45:41 +01:00
Timon 51d479673d Merge branch 'backward-compat-no-tiling' into code-improvements 2026-02-10 12:23:18 +01:00
Timon ede84679d7 code rabbit review stuff 2026-02-10 11:34:29 +01:00
Timon bfd56ccd16 seperate scripts work for angata, except for the word doc. 2026-02-09 20:34:11 +01:00
Timon 3ee3f9e31c shaving off some more details... 2026-02-09 10:40:01 +01:00
DimitraVeropoulou 58d3e655ab
Merge pull request #6 from TimonWeitkamp/SC-119
Sc 119
2026-02-05 14:51:02 +01:00
DimitraVeropoulou 5be79bcc87 Implemented the changed for ISO numbering to 90 script (generated the simple word file) 2026-02-05 12:11:33 +01:00
DimitraVeropoulou cc38d25a54 Changed the week and year numbering to use ISO in the kpi_utils. Update the 80 script to call the function. 2026-02-05 10:54:55 +01:00
Timon Weitkamp db4e8c68e5
Merge pull request #5 from TimonWeitkamp/new_gap_calculation
New gap calculation
2026-02-04 16:41:35 +01:00
DimitraVeropoulou 9f217df98a Changed the generated doc to match the one in Linear (SC-20) BUT i cannot run the coded parts. 2026-02-04 16:24:56 +01:00
Timon e16677eb78 aura until word creation works. word cration itself needs more work. 2026-02-04 12:24:02 +01:00
Timon 5c29c9b549 sc 114 library formatting and cleaning 2026-02-04 09:44:08 +01:00
Timon 85d2f11ed6 issue 113 done, added propper yaml to all files 2026-02-03 17:31:02 +01:00
Timon 8d560ff155 SC-112 Phase 2 Complete: Restructure Script 80 utilities by client type
- Consolidate 80_kpi_utils.R, 80_weekly_stats_utils.R, 80_report_building_utils.R into three client-aware files:
  - 80_utils_common.R (50+ functions): Shared utilities, constants, and helpers
  - 80_utils_agronomic_support.R: AURA-specific KPI calculations (6 KPIs)
  - 80_utils_cane_supply.R: ANGATA placeholder for future expansion
- Move all internal helpers (calculate_cv, calculate_change_percentages, calculate_spatial_autocorrelation, extract_ci_values, etc.) to common
- Add MORAN_THRESHOLD_* constants to common
- Fix parameters_project.R field boundaries path (removed extra 'Data' directory)
- Update 80_calculate_kpis.R with conditional client-type sourcing logic
- Validate both ANGATA (cane_supply) and AURA (agronomic_support) workflows with comprehensive testing
- All 96+ functions accounted for; ready for production use
2026-02-03 17:21:35 +01:00
DimitraVeropoulou f94a6317bd feat: Integrate 2σ gap filling KPI into weekly field analysis
- Changed gap calculation from Q25 to 2σ below median method (kpi_utils.R)
- Integrated gap filling into script 80 with tile-based processing
- Added Gap_score column to field analysis output (Excel/CSV/RDS)
- Fixed memory issues by processing 25 tiles individually instead of merging
- Fixed Field_id matching to ensure gap scores populate correctly

Gap scores now calculate for all 1185 fields with range 0-11.25%
Works with tile-based mosaics (Angata 5x5 grid) without memory errors
2026-02-03 16:41:04 +01:00
Timon 20e3d5b4a3 worked on sc 110 making a 10 utils file and making general log files. 2026-02-03 16:34:49 +01:00
Timon c313f87959 fixed issue 110 moving stuff to 00 common 2026-02-03 16:14:10 +01:00
Timon c4ef10f44f changing paths CS-109 2026-02-03 15:13:21 +01:00
Timon 6efa6b6b05 "wip" 2026-02-03 14:56:04 +01:00
Timon 9e0534cb70 add readme 2026-02-02 15:42:55 +01:00
Timon 86460aa189 table width to page instead of content 2026-02-02 15:37:57 +01:00