Resolve "release v1.4.0"

added Release label

assigned to @leufen1

added 228 commits

55ecf226 - moved abstract model class to separate file
72f271c6 - new FCN module, model classes can now use external parameters if provided
56dd2c7a - FCN name is adjusted to number of layers and hidden units, model setup can now...
32a171f7 - MyLittleModel is replaced by FCN_64_32_16 (both models have same architecture)
bae9ec83 - tests are updated, conftest shouldn't fail on teardown
33a2d164 - corrected activation
97367ce0 - separated model class tests
adff3e91 - report val loss, use log loss monitoring plot scale
6982e322 - add annotation if loss is on val or test
01dc3e2b - ensure loss to be a list when logging
cc14b8b6 - monitoring plot is now always log
571be20d - change log plot call
6f64a485 - Merge branch 'lukas_issue284_feat_create-fcn-model-class' into...
363994d4 - new methods to calculate mae and a bunch of error metrics
e54ef541 - moved table creation to new module
cba186aa - use table methods in training too,
69fb063b - postprocessing now reports different error metrics of test set
317f03c8 - Merge branch 'lukas_issue284_feat_create-fcn-model-class' into 'develop'
dfbbdd31 - moved table test, /close #286 (closed)
3b0bac44 - Merge branch 'lukas_issue286_feat_performance-measures' into 'develop'
782f111e - addendum to FCN class: enable linear activations and add output_activation parameter
704d9976 - Merge branch 'lukas_issue284_feat_create-fcn-model-class' into 'develop'
a1873052 - minor fix to skip calculate error metrics if external data is none
c0b307cc - Merge branch 'lukas_issue286_feat_performance-measures' into 'develop'
4b6e0f72 - log clim skill scores too
3d3f497f - Merge branch 'lukas_issue286_feat_performance-measures' into 'develop'
eec379fc - set dask.compute
fc6625d2 - remove dask from defaultdh
e8e8aa69 - force dask.compute in try except
31e10e8f - Merge branch 'felix_isstue288_tech-dacompute-dump' into 'develop'
f033d85f - new var loss and custom loss methods
7a40c660 - Merge branch 'lukas_issue284_feat_create-fcn-model-class' into 'develop'
29c65d63 - custom objects were missing
6f3675ae - Merge branch 'lukas_issue284_feat_create-fcn-model-class' into 'develop'
b7e2b29a - select from dict can remove none entries, FCN supports dropout and l1/l2 regularization
e5bf65a4 - Merge branch 'lukas_issue284_feat_create-fcn-model-class' into 'develop'
17e37aa8 - catch if regularizer is None but as string
e8eec5ec - Merge branch 'lukas_issue284_feat_create-fcn-model-class' into 'develop'
920fbcb8 - FCN can use an explicite layer configuration, activation layers are now named...
584668a2 - renamed explicite_layer to layer_configuration
ce0e123c - Merge branch 'lukas_issue284_feat_create-fcn-model-class' into 'develop'
8b5f1346 - FCN activation name now works with relu
a2d9d124 - Merge branch 'lukas_issue284_feat_create-fcn-model-class' into 'develop'
33940965 - first CNN class try
30c27e99 - new pad layer names
7e529068 - bigger kernel
7673e830 - kernel size can be set from outside
452b590c - no sympad for CNN
a9640da6 - fix kernelsize for now
56f3657c - changed dense layer
2ba4fe1a - first fix to be able to run again
de191bed - new req bottleneck improves speed for kzf
7376d0c9 - use he init when using relu activations
1f13155f - added prelu activation, alpha dropout is used for selu act, FCN_64_32_16 is...
12b3630e - Merge branch 'lukas_issue284_feat_create-fcn-model-class' into 'develop'
96942e6e - try to fix six error
7aefc11f - change six installation
61486654 - kzf per variable seems to be faster than over variables, check on HPC
faaa3388 - single compute call was missing
891e208f - assure that concat data has no nans
b10bca2b - data handler single station has now a submethod make_input_target
3a3cc762 - can create a hash from all important parameters, lazy loading works for all data handlers
b5f3f9ec - renamed lazy_loading to lazy_preprocessing
f9c10fe3 - replace all pickle calls with dill calls
7cc89dec - Merge branch 'lukas_issue290_bug_fix-separation-of-scales-data-handler' into...
ffe6e643 - Merge branch 'lukas_issue292_feat_data-preprocessing' into...
32f3ff22 - data handlers with filters will create negative values, which is incompatible...
a72c04dc - corrected get statement, plot still not working
023ee744 - Merge branch 'lukas_issue292_feat_data-preprocessing' into 'develop'
145b3d7d - load lazy now just drops a debug message, /close #290 (closed)
121ed8a1 - Merge branch 'lukas_issue290_bug_fix-separation-of-scales-data-handler' into 'develop'
3f2b9806 - include new logging
d1d75c5f - different logging message
0f53dffa - update transform methods to proplery work when external transformation parameetrs are preovided
b03d9577 - Merge branch 'felix_issue295-transformation-parameters-in-data_handler' into 'develop'
01dc6fb2 - log more model information during model setup stage
e5a82238 - Merge branch 'develop' into 'lukas_issue289_feat_cnn-model-class'
ef3ced19 - added dropout to CNN
1ea8b24f - join module now uses a retry strategy, /close #296 (closed) on test success
b3251eb9 - Merge branch 'lukas_issue296_tech_limit-join-retries' into 'lukas_issue289_feat_cnn-model-class'
07919456 - Merge branch 'lukas_issue289_feat_cnn-model-class' of...
4dae57e3 - use dropout in CNNs
4a1d7679 - fix for #296 (closed) to reduce waiting if not internet connection could be established
9806b136 - default data handler and preprocessing support parameter use_multiprocessing....
a1815b49 - updated docs
6e0919f7 - Merge branch 'master' into 'develop'
447ade0f - Merge branch 'lukas_issue297_tech_multiprocessing-switch' into 'develop'
88c70c57 - multiprocessing can now be enabled in debug mode
10446114 - try another table format
4fa68402 - use new table format for defaults
5c72060a - Merge branch 'lukas_issue297_tech_multiprocessing-switch' into 'develop'
0d332667 - added limit for x or y axis
330c1068 - added tmp prints because limits are still exceeded
70f79639 - error is fixed, another try on HPC, on success /close #301 (closed)
9cd6a8ab - another adjustment
469786fa - Merge branch 'lukas_issue301_refac_limit-axis-in-competing-skill-score-plot' into 'develop'
317f2446 - split plots into abstract, pre, and postprocessing plots
175841d5 - moved availability and station map to preprocessing
ab5136ae - periodogram plot is included in preprocessing plotting for first time
8f2b1be9 - added overall plot including all variables
95688d30 - added short description
37c6a279 - PlotPeriodogram now can plot periodogram before and after filtering
8e40c948 - moved plotting back from preprocessing to postprocessing to have a single...
e664f716 - added legend
da4d59e9 - added sample plot into docs
26fbafb8 - can be merged now on test pass, /close #
35b5308b - fixed legend position /close #298 (closed)
2db5aa0e - Merge branch 'lukas_issue298_feat_periodogram' into 'develop'
fcec60ca - Merge branch 'develop' into 'lukas_issue299_feat_histogram_plots'
1d23deff - new plot PlotDataHistogram plots transformed inputs and targets
6f02e87b - PlotDataHistogram can compare subsets
03ef6301 - hist edges are now dynamically adjusted per variable
0bc63e8f - added docstring and exemplary graph
e4dce9fb - updated defaults test, /close #299 (closed) on test success
6bfe823b - Merge branch 'lukas_issue299_feat_histogram_plots' into 'develop'
52d6fd13 - appendix include time measurement
2867cae7 - Merge branch 'lukas_issue299_feat_histogram_plots' into 'develop'
8ec9b05f - TrackParameter wraps now entire method to get the return value
19e3aab7 - removed duplicated logging, /close #304 (closed)
0f62f9b2 - Merge branch 'lukas_issue304_refac_improve-datastore-logging' into 'develop'
5f9fdceb - min max scaler can now read parameter feature_range to set normalization...
28ef8cbe - Merge branch 'lukas_issue302_refac_adjust-min-max-scaler' into 'develop'
e67e16c3 - offset is implemented in data handler, /close #305 (closed)
b333c7d2 - Merge branch 'lukas_issue305_feat_offset-seperation-of-scales-data-handler' into 'develop'
20972e29 - Merge branch 'lukas_issue294_tech_improve-preprocessing-logging' into 'develop'
47813afa - index array was missing
eb0d5139 - Merge branch 'develop' into 'lukas_issue298_feat_periodogram'
96ce12e8 - Merge branch 'lukas_issue298_feat_periodogram' into 'develop'
22ab59c8 - kz filter has moved to a new location together with the new FIR filter class,...
b0637556 - datahandler kz and fir now inherit from a general filter data handler
ec34a136 - new class DataHandlerMixedSamplingWithFilterSingleStation that bundles common...
607fc803 - filter width for fir filter is now correct
37a30a9f - test will now pass
0eb8c234 - periodogram will not plot the "unfiltered" filter component
f29988ee - periodogram is now normalized
2e52fa71 - missmatch between hash and parameter name
3bcb957f - added proposed if clause, /close #307 (closed) if but disappears in test setup
9b0e0caf - Merge branch 'lukas_issue306_feat_data-handler-fir-filter' into...
85a11de3 - Merge branch...
a6ba5850 - fir filter can be used with daily data
4d580107 - Merge branch 'lukas_issue306_feat_data-handler-fir-filter' of...
4c596cc8 - small fix
6917b04a - MLAir can store parameters during preprocessing from train subset when using store_attributes
2652975d - new fir filter data handler using climatological heuristics
3bf973c8 - filter code has much more comments for understanding, time range of apriori is extended if required
be60dba2 - climFIR data handler can create a sample plot if a path is provided.
15dc6218 - implemented vectorized version of fir filter for faster computation
202d9baa - add log statement to track progress
955426d7 - added a numpy filter version (should be again faster)
1892f3cb - added debug logging
1215576e - add exception if filter input plot wasn't successful
f13604b0 - removed debug slice
e32f012e - try out dask approach
4ab948e3 - maybe found axis bug
0682b903 - speed comparison
d28ad0a0 - new try with convolve
82c4ba1e - new data handler for mixed sampling and climate fir, fine tuning is required...
c7b75f3e - filter plots different seasons, filter returns data with missing values now (not squeezed version)
09d8ceda - use less memory intense version for clim_filter_vectorized to avoid memory issues
9e4c6db8 - add gc collect statement
d31c0176 - solved lazy error, some station removals have to be fixed still
754e61f0 - added many loggings to find HPC error
939f1980 - more loggings
9ff55017 - more loggings
dcfde574 - interpolate now takes care, that missing values are not dropped but indicated with nans
57999dac - add another gc collect
1f1e658d - add another gc collect
e96d635b - add index error to f_proc
df510cdb - new version now applies along window axis instead of just using t0
23c8ade0 - extra loop for each year to prevent memory issues
5bc7ec6d - use single precision for filter, reduce data size always as much as possible
1cb0624b - store intermediate plot implementation, must be refactored
d591487b - disable plotting for now to have running module
0a74a59c - add vanilla rnn
70d0d9df - small change
f384b448 - plotting works better but is still too messy, improved rnn class
24808a64 - use mse loss for rnn
fd5fe608 - new method to calculate seasonal diurnal anomalies
74e6e53c - Merge branch 'lukas_issue289_feat_cnn-model-class' into 'develop'
8da0c387 - Merge branch 'lukas_issue289_feat_cnn-model-class' into...
3a94611e - add dense layer between rnn and output
97ca2fa3 - fixed typo
19e758cc - split activation for rnn and dense layer part
e872a388 - added new parameter dropout_rnn
a6cd5f5c - all filter data handlers can now return either filter portions as dimension or distinct branches
e3de37e4 - new FCN class using branched inputs (can be combined with branched filter data handler)
92763f13 - added param max_number_multiprocessing to set maximum number of processes to...
c846a7fe - adjusted preprocessing tests
e3e230f8 - Merge branch 'lukas_issue308_tech_max-number-of-parallel-processes' into...
e4c9fdb5 - Implementation of IntelliO3_ts_architecture
6ee12817 - Updated test to test on IntelliO3_ts_architecture instead of the old MyPaperModel
fab62a19 - Merge branch 'vincent_issue310-intellio3-implementation-into-mlair' into 'develop'
8324b338 - added bugfix, /close #311 (closed) on pipeline success
e914db41 - Merge branch 'lukas_issue311_bug_fileexistserror-in-cleanup' into 'develop'
658f4ddf - first draft of callback
160bf15f - update timing callback
72c1d3d2 - include epotimingcallback into workflow
6f29d408 - Merge branch 'felix_issue312-callback-track-epoch-runtime' into 'develop'
a2a6b331 - new plot class PlotClimateFirFilter
8ea88529 - cleanup, remove outdated validate_station_old method
fef96a03 - changed helpers/statistics.py 299 AND 325 ahead_names to the actual times,...
6f433745 - data handler with filters can use kzf coeffs, improved a priori creation
4eee713d - periodogram works with window dim
85a74b58 - histogram can handle branched inputs
f68ecb48 - /close #306 (closed) on pipeline success
1858c716 - removed unused helper method
bfa34e4b - Merge branch 'lukas_issue306_feat_data-handler-fir-filter' into 'develop'
b3588961 - updated PlotBootstrapSkillScore
54c5f1c1 - added new bootstrap method "zero mean" and type "single input" and "variable"
c7f4a920 - cleanup, remove commented code
271c10d0 - bootstrap method and type can be set during experiment setup
83888fdc - added branch bootstrap type
08c206f5 - ahead_dim=ahead now as kwarg to skill_score() and climatological_skill_score()
e8b75730 - changed filter logging, added try statement on plotting
9e9e74ce - adjust minmax scaling for filtered data to standardise
d3dca8fa - Merge branch...
ad6db881 - Merge branch 'develop' into 'lukas_issue300_feat_mean-bootstrapping'
a843aaeb - extended development from #313 (closed) to be more flexible
87b5b2b1 - Merge branch 'lukas_issue300_feat_mean-bootstrapping' into 'develop'
d9a0aee0 - MLAir can store start script if provided via start_script=__file__
61f97525 - added start script argument to all run scripts
fbc1e07d - Merge branch 'lukas_issue300_feat_mean-bootstrapping' into 'lukas_issue099_tech_store-run-script'
6846bf7c - Merge branch 'lukas_issue099_tech_store-run-script' into 'develop'
e75f14ae - Start debugging
41211579 - Enabled window_lead_time=1
63e222e5 - Enabled window_lead_time=1
f7970fb3 - Merge branch 'vincent_issue315-enablewindowleadtime_1-2' into 'develop'
45a52a3c - Merge branch 'develop' into 'release_v1.4.0'

Compare with previous version

added 1 commit

69ad27e0 - updated changelog, readme, docs, dist file

Compare with previous version

marked this merge request as ready

enabled an automatic merge when the pipeline for 69ad27e0 succeeds

merged

mentioned in commit 1634c669

Resolve "release v1.4.0"

Merge request reports

Activity