Commit graph

122 commits

Author SHA1 Message Date
Timon ef29cb5c2c Move experimental files to r_app/experiments 2026-01-14 11:07:40 +01:00
Timon 6d5509dd1b Remove: cleanup test/draft files not in Bitbucket 2026-01-14 11:05:57 +01:00
Timon dfa0aa900d updated website and small things 2026-01-14 11:02:45 +01:00
Timon fc7e5f1ee0 Enhance download progress feedback and optimize tile overlap checks
- Added a progress bar to the tile download process for better user feedback.
- Simplified the tile overlap checking logic in the R script to improve performance and readability.
2026-01-13 11:30:38 +01:00
Timon 03f269302a SC-58: Implement grid filtering and per-date tiling
- Filter master grid to only overlapping tiles based on GeoJSON field boundaries
- Implement per-date tiling for resumable processing (can stop/restart anytime)
- Add grid-size versioning (subfolder structure: daily_tiles_split/5x5/, etc)
- Skip already-processed dates for idempotent execution
- Upfront extent checking (one-time), per-date processing (resumable)
- Reduce storage by excluding empty tiles outside field boundaries
2026-01-13 09:35:51 +01:00
Timon cb63cf00b8 updated code to fit in workflow better 2026-01-12 16:33:23 +01:00
Timon 182d13d593 wip 2026-01-12 14:55:25 +01:00
Timon dc7c346854 updated whole workflow and architercutre md 2026-01-12 09:34:13 +01:00
Timon d22dc2f96e commit all stuff 2026-01-06 14:17:37 +01:00
Timon d5fd4bb463 Add KPI reporting system and deployment documentation
Major Changes:
- NEW: Scripts 09 & 10 for KPI calculation and enhanced reporting
- NEW: Shell script wrappers (01-10) for easier execution
- NEW: R packages flextable and officer for enhanced Word reports
- NEW: DEPLOYMENT_README.md with complete deployment guide
- RENAMED: Numbered R scripts (02, 03, 04) for clarity
- REMOVED: Old package management scripts (using renv only)
- UPDATED: Workflow now uses scripts 09->10 instead of 05

Files Changed: 90+ files
New Packages: flextable, officer
New Scripts: 09_run_calculate_kpis.sh, 10_run_kpi_report.sh
Documentation: DEPLOYMENT_README.md, EMAIL_TO_ADMIN.txt

See DEPLOYMENT_README.md for full deployment instructions.
2025-10-14 11:49:30 +02:00
Martin Folkerts d258a2bf2e cleaned the folders, made some parameters 2025-09-05 15:23:41 +02:00
Martin Folkerts 77d67c36ca Merge branch 'code-improvements' 2025-06-25 11:03:33 +02:00
Timon a6aa002d33 minor visualistion chagnes 2025-06-25 11:01:37 +02:00
Martin Folkerts 0e7f5cf11d Merge branch 'code-improvements' 2025-06-25 10:47:11 +02:00
Timon ea6842af48 minor visualistion chagnes 2025-06-25 10:39:26 +02:00
Martin Folkerts cc6b9392d6 Merge branch 'code-improvements' 2025-06-25 09:35:19 +02:00
Timon b2fcd66d2b klaar voor testen, wat plaatjes e.d. aangepast 2025-06-24 21:02:54 +02:00
Timon 4d6439d5e0 Add reproducible R package management system
- Add renv.lock with exact package versions for reproducibility
- Add package_manager.R for automated package installation/updates
- Add extract_current_versions.R for package discovery
- Configure renv environment for team collaboration

All team members can now run source('r_app/package_manager.R') to get identical package environment
2025-06-24 14:51:22 +02:00
Martin Folkerts a316b30afc Merge branch 'code-improvements' 2025-06-24 09:58:56 +02:00
Timon 6efcc8cfec Fix CI report pipeline: update tmap v4 syntax, add continuous color scales, fix formatting
- Updated all CI maps to use tm_scale_continuous() for proper tmap v4 compatibility
- Added fixed color scale limits (1-8 for CI, -3 to +3 for differences) for consistent field comparison
- Fixed YAML header formatting issues in CI_report_dashboard_planet.Rmd
- Positioned RGB map before CI overview map as requested
- Removed all obsolete use_breaks parameter references
- Enhanced error handling and logging throughout the pipeline
- Added new experimental analysis scripts and improvements to mosaic creation
2025-06-19 20:37:20 +02:00
Timon bb2a599075 Enhanced SmartCane executive summary report with explanatory text and fixed priority map coloring
Added explanatory text for all visualizations
Fixed priority map color scheme (red=high priority, green=low priority)
Improved error handling in farm health data calculations
Added fallback mechanisms for missing data
2025-04-23 09:47:19 +02:00
Timon 2bed5949fa Refactor CI plotting functions to use proper parameterization
- Refactored ci_plot and cum_ci_plot functions to accept explicit parameters
- Added default values for backward compatibility
- Updated CI_report_dashboard_planet.Rmd to pass explicit parameters
- Added input validation for better error handling
- Added parameter documentation in function headers
- Removed reliance on global variables for better maintainability
2025-04-22 21:41:18 +02:00
Timon 07aee7bed1 –[200~Improve CI report visualization and migrate to terra package
- Replace raster package with terra throughout the codebase
- Update map visualizations with better layout and legends
- Add descriptive headers to report sections
- Improve map legend positioning and sizing
- Enhance error handling for missing data
- Remove redundant legends in field-specific visualizations
- Optimize figure dimensions to prevent page overflow
- Expand documentation of CI index and report components
- Update package dependencies in packages.
2025-04-22 20:55:02 +02:00
Timon fbc8f5e11b wip 2025-04-22 17:43:11 +02:00
Martin Folkerts eb9803fbf1 Removed yieldprediction from CI_report_dashboard_planet.Rmd edited online with Bitbucket 2025-04-02 12:53:29 +00:00
Martin Folkerts ddad4240d5 added conditional to not run prediction if requirements are not met 2025-03-25 16:09:31 +01:00
Timon 29e2867b41 adding docx 2025-03-25 10:42:04 +01:00
Martin Folkerts dd1ee2b1a0 adjusted dates to iso dates 2025-01-07 14:24:38 +01:00
Timon d0ff25acf9 timely save 2024-12-16 16:26:34 +01:00
Martin Folkerts 9b29dc4d57 updated signature of cum ci plot 2024-12-03 09:32:04 +01:00
Martin Folkerts 3bfa7e1750 some update to get mkulazi to work 2024-11-18 13:41:58 +01:00
Martin Folkerts 576250982c fixed plot colouring and made ci_extraction resilient against none file; 2024-11-11 20:55:59 +01:00
Martin Folkerts c8ef406545 added Catalog package with config and changed iteration to use available_slots 2024-11-11 10:26:02 +01:00
Martin Folkerts db68fd8e83 removed column for plot colors 2024-11-07 11:43:09 +01:00
Martin Folkerts 3093c86e3a okay 2024-10-31 22:35:59 +01:00
Timon c1a32bf6ad Refactor cum_ci_plot function for enhanced plotting options; added parameters for plot type and season filtering; improved x-axis labeling and updated ggplot aesthetics. Also, continued work on yield prediction in R. 2024-10-31 11:21:39 +01:00
Martin Folkerts ddb4fdbc02 updated date format for excel 2024-10-28 15:57:23 +01:00
Martin Folkerts f08da04c3b added DownloadCreditsCommand some updates 2024-10-23 09:34:52 +02:00
Martin Folkerts 056b8dd67b okay 2024-09-17 14:56:33 +02:00
Martin Folkerts 4beca30d2e okay 2024-08-30 16:27:32 +02:00
Martin Folkerts 7bf4f0930d added log as project file; 2024-08-30 16:16:26 +02:00
Martin Folkerts 499744db6d moved logging arroudn 2024-08-30 12:09:13 +02:00
Martin Folkerts 7d671ba69c moved end_date and added a is.na wrapping to set when running in R_Studio 2024-08-30 10:37:02 +02:00
Timon 4dd84b10a5 source(utils) aangepast voor online versie 2024-08-30 09:52:02 +02:00
Timon bd9b7d4ab0 adjusted all functions and cleaned scripts incl rmd file 2024-08-29 16:48:24 +02:00
Timon 611bc17017 adjusted all functions and cleaned scripts 2024-08-29 16:35:59 +02:00
Martin Folkerts ad2f41482f updated create_report.sh to have borders option 2024-08-28 14:52:42 +02:00
Martin Folkerts 2598306643 removed chemba as a option from parameters so it is treathed as a regular project 2024-08-28 10:18:53 +02:00
Martin Folkerts 23ba088434 added logging to getTifsAsZip 2024-08-27 11:46:34 +02:00
Martin Folkerts 509f924c58 me 2024-08-26 16:23:52 +02:00