Commit graph

487 commits

Author SHA1 Message Date
Timon 054cc85bdb small issues 2026-02-10 15:38:23 +01:00
Timon 0dc46628fd Address CodeRabbit review feedback - [description of changes] 2026-02-10 12:45:41 +01:00
Timon 51d479673d Merge branch 'backward-compat-no-tiling' into code-improvements 2026-02-10 12:23:18 +01:00
Timon 1867101032 Merge branch 'code-improvements' of https://github.com/TimonWeitkamp/smartcane_experimental_area into code-improvements 2026-02-10 11:34:40 +01:00
Timon ede84679d7 code rabbit review stuff 2026-02-10 11:34:29 +01:00
Nik Verweel b1cffdad1d Create ODK Viewer web tool 2026-02-10 10:33:47 +01:00
Timon bfd56ccd16 seperate scripts work for angata, except for the word doc. 2026-02-09 20:34:11 +01:00
Timon 3ee3f9e31c shaving off some more details... 2026-02-09 10:40:01 +01:00
DimitraVeropoulou 58d3e655ab
Merge pull request #6 from TimonWeitkamp/SC-119
Sc 119
2026-02-05 14:51:02 +01:00
DimitraVeropoulou 5be79bcc87 Implemented the changed for ISO numbering to 90 script (generated the simple word file) 2026-02-05 12:11:33 +01:00
Nik Verweel 654742ab22 Add API specific exclusions to gitignore to prevent accidental token pushing 2026-02-05 11:37:01 +01:00
DimitraVeropoulou cc38d25a54 Changed the week and year numbering to use ISO in the kpi_utils. Update the 80 script to call the function. 2026-02-05 10:54:55 +01:00
Timon Weitkamp db4e8c68e5
Merge pull request #5 from TimonWeitkamp/new_gap_calculation
New gap calculation
2026-02-04 16:41:35 +01:00
DimitraVeropoulou 9f217df98a Changed the generated doc to match the one in Linear (SC-20) BUT i cannot run the coded parts. 2026-02-04 16:24:56 +01:00
Nik Verweel 4b1a51d0e9 Add mill layer option to GeoJSON viewer 2026-02-04 13:40:06 +01:00
Timon e16677eb78 aura until word creation works. word cration itself needs more work. 2026-02-04 12:24:02 +01:00
Nik Verweel 7c55b38954 GeoJSON viewer overhaul 2026-02-04 11:48:10 +01:00
Timon 5c29c9b549 sc 114 library formatting and cleaning 2026-02-04 09:44:08 +01:00
Timon 85d2f11ed6 issue 113 done, added propper yaml to all files 2026-02-03 17:31:02 +01:00
Timon 8d560ff155 SC-112 Phase 2 Complete: Restructure Script 80 utilities by client type
- Consolidate 80_kpi_utils.R, 80_weekly_stats_utils.R, 80_report_building_utils.R into three client-aware files:
  - 80_utils_common.R (50+ functions): Shared utilities, constants, and helpers
  - 80_utils_agronomic_support.R: AURA-specific KPI calculations (6 KPIs)
  - 80_utils_cane_supply.R: ANGATA placeholder for future expansion
- Move all internal helpers (calculate_cv, calculate_change_percentages, calculate_spatial_autocorrelation, extract_ci_values, etc.) to common
- Add MORAN_THRESHOLD_* constants to common
- Fix parameters_project.R field boundaries path (removed extra 'Data' directory)
- Update 80_calculate_kpis.R with conditional client-type sourcing logic
- Validate both ANGATA (cane_supply) and AURA (agronomic_support) workflows with comprehensive testing
- All 96+ functions accounted for; ready for production use
2026-02-03 17:21:35 +01:00
DimitraVeropoulou f94a6317bd feat: Integrate 2σ gap filling KPI into weekly field analysis
- Changed gap calculation from Q25 to 2σ below median method (kpi_utils.R)
- Integrated gap filling into script 80 with tile-based processing
- Added Gap_score column to field analysis output (Excel/CSV/RDS)
- Fixed memory issues by processing 25 tiles individually instead of merging
- Fixed Field_id matching to ensure gap scores populate correctly

Gap scores now calculate for all 1185 fields with range 0-11.25%
Works with tile-based mosaics (Angata 5x5 grid) without memory errors
2026-02-03 16:41:04 +01:00
Timon 20e3d5b4a3 worked on sc 110 making a 10 utils file and making general log files. 2026-02-03 16:34:49 +01:00
Timon c313f87959 fixed issue 110 moving stuff to 00 common 2026-02-03 16:14:10 +01:00
Timon c4ef10f44f changing paths CS-109 2026-02-03 15:13:21 +01:00
Timon 6efa6b6b05 "wip" 2026-02-03 14:56:04 +01:00
Timon 9e0534cb70 add readme 2026-02-02 15:42:55 +01:00
Timon 86460aa189 table width to page instead of content 2026-02-02 15:37:57 +01:00
Timon 3fe1cf8638 removed emoticons 2026-02-02 15:35:36 +01:00
DimitraVeropoulou 19986706b9 changed the gap_score calculation from using the lower 25% of CI values to excluding pixels eith values 2σ lower than the median. 2026-02-02 13:30:06 +01:00
Timon 14300f6832 updating inbetween stuff, not finished yet 2026-02-02 12:07:10 +01:00
DimitraVeropoulou 39536ab72a testing 2026-02-02 11:49:04 +01:00
Timon 1c08070965 script 40 per-field weekly mosaics - tested with aura 2026-01-29 21:49:15 +01:00
Timon 9b8c971902 script 30 refactored to per field 2026-01-29 21:36:47 +01:00
Timon 4d6bba828f refactored 10 20 2026-01-29 21:10:24 +01:00
Timon d1f352f21c updated sc-91 2026-01-29 17:26:03 +01:00
Timon 4445f72e6f works for angata and aura 2026-01-29 16:04:04 +01:00
Timon dd915f9b9e adjusting scripts to work for all projects 2026-01-29 09:04:46 +01:00
Timon b2de819fc4 Fix backward compatibility: Support non-tiled (single-file) mosaic projects
- Script 80: Add fallback logic to detect and handle single-file mosaics
- Weekly stats utils: Support both tile-based and single-file mosaic detection
- Pipeline runner: Auto-detect mosaic mode (tiled vs single-file)
- Flexible grid size detection for tile-based projects (5x5, 10x10, etc)

Fixes:
- Script 80 now checks weekly_tile_max/{grid_size} first, falls back to weekly_mosaic
- calculate_field_statistics handles both tile patterns and single-file patterns
- run_full_pipeline detects project mode automatically
- All verification checks are now flexible and don't assume fixed paths

Projects like 'aura' (small ROI < 10km) will use single-file approach automatically
Projects like 'angata' (large ROI >= 10km) will use tile-based approach automatically
2026-01-28 11:19:07 +01:00
Nik Verweel fde60cbbdf Additional CSV delimiter fix 2026-01-28 09:59:11 +01:00
Nik Verweel 1646b5dd2d Fixed exported CSV delimiter to comma for easier opening 2026-01-28 09:54:36 +01:00
Nik Verweel 89588201bd Added extra functionality to geojson viewer (search and zoom), plus label fixes 2026-01-27 18:17:01 +01:00
Nik Verweel 0a19473292 Enhanced zooming and filtering mechanics for sugar mill web app 2026-01-27 17:39:19 +01:00
Nik Verweel 06299cc99f Added polygon analysis functionality 2026-01-27 17:32:01 +01:00
Nik Verweel e87f0f46aa Add frontpage link to the polygon editor 2026-01-27 14:01:44 +01:00
Nik Verweel f231911d7b Mill viewer updates and fixes 2026-01-27 10:32:39 +01:00
Timon 40a7d4d691 Merge code-improvements: integrate remote changes 2026-01-27 09:20:05 +01:00
Timon Weitkamp 24401d436a
Merge pull request #4 from TimonWeitkamp/timon/sc-64-apply-the-new-structure-to-the-code
Timon/sc 64 apply the new structure to the code. mainly new numbering structure, and cleaned some code.
2026-01-27 09:12:51 +01:00
Timon 9a55d2fcf8 Refactor full pipeline script to include intelligent checking of existing outputs and dynamic execution of scripts. Added new Python scripts for RGB validation and evaluation template creation. Enhanced error handling and logging throughout the pipeline. 2026-01-27 08:58:06 +01:00
Timon 4143bdf4d7 updateing csv file 2026-01-20 12:06:45 +01:00
Timon c11b10a73f working on visualisation, not working too well... 2026-01-18 11:25:31 +01:00