Timon/SmartCane
1
1
Fork 0
Code Issues Pull requests Actions Packages Projects Releases Wiki Activity
364 commits 1 branch 0 tags 252 MiB
Commit graph

364 commits

This branch
This branch
All branches
Author SHA1 Message Date
Nik Verweel b1cffdad1d Create ODK Viewer web tool 2026-02-10 10:33:47 +01:00
DimitraVeropoulou 58d3e655ab
Merge pull request #6 from TimonWeitkamp/SC-119 
Sc 119
 2026-02-05 14:51:02 +01:00
DimitraVeropoulou 5be79bcc87 Implemented the changed for ISO numbering to 90 script (generated the simple word file) 2026-02-05 12:11:33 +01:00
Nik Verweel 654742ab22 Add API specific exclusions to gitignore to prevent accidental token pushing 2026-02-05 11:37:01 +01:00
DimitraVeropoulou cc38d25a54 Changed the week and year numbering to use ISO in the kpi_utils. Update the 80 script to call the function. 2026-02-05 10:54:55 +01:00
Timon Weitkamp db4e8c68e5
Merge pull request #5 from TimonWeitkamp/new_gap_calculation 
New gap calculation
 2026-02-04 16:41:35 +01:00
DimitraVeropoulou 9f217df98a Changed the generated doc to match the one in Linear (SC-20) BUT i cannot run the coded parts. 2026-02-04 16:24:56 +01:00
Nik Verweel 4b1a51d0e9 Add mill layer option to GeoJSON viewer 2026-02-04 13:40:06 +01:00
Nik Verweel 7c55b38954 GeoJSON viewer overhaul 2026-02-04 11:48:10 +01:00
DimitraVeropoulou f94a6317bd feat: Integrate 2σ gap filling KPI into weekly field analysis 
- Changed gap calculation from Q25 to 2σ below median method (kpi_utils.R)
- Integrated gap filling into script 80 with tile-based processing
- Added Gap_score column to field analysis output (Excel/CSV/RDS)
- Fixed memory issues by processing 25 tiles individually instead of merging
- Fixed Field_id matching to ensure gap scores populate correctly

Gap scores now calculate for all 1185 fields with range 0-11.25%
Works with tile-based mosaics (Angata 5x5 grid) without memory errors
 2026-02-03 16:41:04 +01:00
Timon 9e0534cb70 add readme 2026-02-02 15:42:55 +01:00
Timon 86460aa189 table width to page instead of content 2026-02-02 15:37:57 +01:00
Timon 3fe1cf8638 removed emoticons 2026-02-02 15:35:36 +01:00
DimitraVeropoulou 19986706b9 changed the gap_score calculation from using the lower 25% of CI values to excluding pixels eith values 2σ lower than the median. 2026-02-02 13:30:06 +01:00
DimitraVeropoulou 39536ab72a testing 2026-02-02 11:49:04 +01:00
Nik Verweel fde60cbbdf Additional CSV delimiter fix 2026-01-28 09:59:11 +01:00
Nik Verweel 1646b5dd2d Fixed exported CSV delimiter to comma for easier opening 2026-01-28 09:54:36 +01:00
Nik Verweel 89588201bd Added extra functionality to geojson viewer (search and zoom), plus label fixes 2026-01-27 18:17:01 +01:00
Nik Verweel 0a19473292 Enhanced zooming and filtering mechanics for sugar mill web app 2026-01-27 17:39:19 +01:00
Nik Verweel 06299cc99f Added polygon analysis functionality 2026-01-27 17:32:01 +01:00
Nik Verweel e87f0f46aa Add frontpage link to the polygon editor 2026-01-27 14:01:44 +01:00
Nik Verweel f231911d7b Mill viewer updates and fixes 2026-01-27 10:32:39 +01:00
Timon 40a7d4d691 Merge code-improvements: integrate remote changes 2026-01-27 09:20:05 +01:00
Timon Weitkamp 24401d436a
Merge pull request #4 from TimonWeitkamp/timon/sc-64-apply-the-new-structure-to-the-code 
Timon/sc 64 apply the new structure to the code. mainly new numbering structure, and cleaned some code.
 2026-01-27 09:12:51 +01:00
Timon 9a55d2fcf8 Refactor full pipeline script to include intelligent checking of existing outputs and dynamic execution of scripts. Added new Python scripts for RGB validation and evaluation template creation. Enhanced error handling and logging throughout the pipeline. 2026-01-27 08:58:06 +01:00
Timon 4143bdf4d7 updateing csv file 2026-01-20 12:06:45 +01:00
Timon c11b10a73f working on visualisation, not working too well... 2026-01-18 11:25:31 +01:00
Timon 9f312131d7 integration lstm 31 and 80 complete - angata kpi file now dynamic 2026-01-18 10:14:08 +01:00
Timon 1f5add7485 refactored script 80 2026-01-18 09:27:16 +01:00
Timon 41bbc370f2 harvest pred working better now 2026-01-18 08:22:02 +01:00
Timon 7975f8ad06 8 week data working now 2026-01-18 07:39:30 +01:00
Timon 3e4430b3be added last columns of trends, only harvest imminent and age left to do 2026-01-16 09:10:39 +01:00
Timon 8d84c8cab5 phase 2 cv trend implemented 2026-01-16 08:30:47 +01:00
Timon 6e88acef25 added some more stats and functions calculate and export csv and rds file for future ref 2026-01-16 08:04:45 +01:00
Timon 4e94a9a78b expanding csv table 2026-01-15 15:35:16 +01:00
Timon fabbf3214d Enhance harvest detection logic and testing framework 
- Updated `detect_mosaic_mode` function to check for grid-size subdirectories in addition to tile-named files.
- Added comprehensive tests for DOY reset logic in `test_doy_logic.py`.
- Implemented feature extraction tests in `test_feature_extraction.py`.
- Created tests for growing window method in `test_growing_window_only.py`.
- Developed a complete model inference test in `test_model_inference.py`.
- Added a debug script for testing two-step refinement logic in `test_script22_debug.py`.
 2026-01-15 14:30:54 +01:00
Timon d6448b8703 Refactor: Update system architecture documentation to reflect Python integration and add complete pipeline overview 2026-01-15 10:25:38 +01:00
Timon 4c7ca85d29 Add script 23: Convert harvest format from production to standard, remove diagnostic script 2026-01-15 09:28:13 +01:00
Timon 7b347ddba6 Fix: Revert run_phase1_growing_window to original GitHub version (off-by-one fix) and move test scripts to harvest_detection_experiments/tests 2026-01-15 09:08:07 +01:00
Timon beedf2f94c wip 2026-01-15 08:23:52 +01:00
Timon 458b8247be Cleanup: Fix CI formula, reorganize shell scripts and test files 
- Fixed CI calculation: changed from NDVI (NIR-Red)/(NIR+Red) to correct NIR/Green-1 formula in:
  * process_single_tile() function
  * create_ci_band() utility function
  * Updated create_mask_and_crop() documentation

- Renamed numbered shell scripts for clarity (matching R script numbering):
  * 01_run_planet_download -> 10_planet_download.sh
  * 02_run_ci_extraction -> 20_ci_extraction.sh
  * 03_run_growth_model -> 30_growth_model.sh
  * 04_run_mosaic_creation -> 40_mosaic_creation.sh
  * 09_run_calculate_kpis -> 80_calculate_kpis.sh
  * 10_run_kpi_report -> 90_kpi_report.sh

- Archived obsolete shell scripts to old_sh/:
  * build_mosaic.sh, build_report.sh, interpolate_growth_model.sh
  * 05_run_dashboard_report.sh, 06_run_crop_messaging.sh
  * 11_run_yield_prediction.sh/ps1
  * runcane.sh, runpython.sh, smartcane.sh, update_RDS.sh

- Deleted test/debug files and temporary outputs:
  * analyze_*.R, benchmark_gpu_vs_cpu.py, convert_angata_harvest.py
  * debug_mosaic.R, examine_kpi_results.R, generate_sar_report.R
  * inspect_8band_structure.R, inspect_tif_bands.R
  * old_working_utils.R, predict_harvest_operational.R
  * run_kpi_calculation.R, run_report.R, simple_sar_test.R
  * data_validation_tool/, harvest_ci_pattern_analysis.png, kpi_debug.out

- Enhanced harvest prediction: Added threshold tuning (0.40-0.45) and field type handling

- Enhanced mosaic creation: Improved tile detection and routing logic
 2026-01-14 16:58:51 +01:00
Timon d365b5838b Move: archive old KPI scripts (09, 09b, 09c, 20) to old_scripts/ for testing 2026-01-14 11:37:13 +01:00
Timon 04e1641a18 Create 80_calculate_kpis.R: unified KPI calculation (per-field SC-64 + farm-level metrics) 2026-01-14 11:36:06 +01:00
Timon 62106eeb3b Update: source() calls to reference renamed util files (20_, 30_, 40_) 2026-01-14 11:24:27 +01:00
Timon ab19c2b99d Rename: python scripts to match pipeline stage numbers 2026-01-14 11:21:05 +01:00
Timon b7ef583efa Rename: number utils to match their main scripts 2026-01-14 11:16:23 +01:00
Timon 5aa456fbf5 Rename: 01_ to 10_ for stage consistency 2026-01-14 11:12:11 +01:00
Timon e69a7c5465 Rename: align stage numbering with Bitbucket structure 2026-01-14 11:10:28 +01:00
Timon 252b4049b3 Rename: align stage numbering with Bitbucket structure 2026-01-14 11:08:33 +01:00
Timon ef29cb5c2c Move experimental files to r_app/experiments 2026-01-14 11:07:40 +01:00