Resolve "implement lazy data preprocessing" (!274) · Merge requests · esde / machine-learning / MLAir · GitLab

Snippets Groups Projects

Merged Ghost User requested to merge lukas_issue292_feat_data-preprocessing into develop 4 years ago

Mar 17, 2021
- Merge branch 'lukas_issue290_bug_fix-separation-of-scales-data-handler' into... · 7cc89dec
  lukas leufen authored 4 years ago
  
  Merge branch 'lukas_issue290_bug_fix-separation-of-scales-data-handler' into 'lukas_issue292_feat_data-preprocessing' # Conflicts: # mlair/data_handler/data_handler_mixed_sampling.py
  7cc89dec
- replace all pickle calls with dill calls · f9c10fe3
  leufen1 authored 4 years ago
  
  f9c10fe3
- renamed lazy_loading to lazy_preprocessing · b5f3f9ec
  leufen1 authored 4 years ago
  
  b5f3f9ec
- can create a hash from all important parameters, lazy loading works for all data handlers · 3a3cc762
  leufen1 authored 4 years ago
  
  3a3cc762
- data handler single station has now a submethod make_input_target · b10bca2b
  leufen1 authored 4 years ago
  
  b10bca2b
Mar 16, 2021
- assure that concat data has no nans · 891e208f
  leufen1 authored 4 years ago
  
  891e208f
- single compute call was missing · faaa3388
  leufen1 authored 4 years ago
  
  faaa3388
- kzf per variable seems to be faster than over variables, check on HPC · 61486654
  leufen1 authored 4 years ago
  
  61486654
Mar 12, 2021
- new req bottleneck improves speed for kzf · de191bed
  leufen1 authored 4 years ago
  
  de191bed
- first fix to be able to run again · 2ba4fe1a
  leufen1 authored 4 years ago
  
  2ba4fe1a