Commits · f5100d282559d7b1d8b093fac521cc39091a058b · eFlows4HPC WP2 / Data Logistics Service

Apr 01, 2022
- optional registration in upload · f5100d28
  Jedrzej Rybicki authored 3 years ago
  
  f5100d28
Mar 24, 2022
- image transfer dag · b18868b7
  Jedrzej Rybicki authored 3 years ago
  
  b18868b7
Mar 23, 2022
- mkdir p on target · 8bfabd2c
  Jedrzej Rybicki authored 3 years ago
  
  8bfabd2c
- directory making for upload, and removal temp files for registration · 5ccb37b5
  Jedrzej Rybicki authored 3 years ago
  
  5ccb37b5
- host, user, port now comes as pipelines parameters · 7d34227f
  Jedrzej Rybicki authored 3 years ago
  
  7d34227f
Mar 22, 2022
- default host ist bsc now · af9aab12
  Jedrzej Rybicki authored 3 years ago
  
  af9aab12
- secret path in vault · 8daef8c8
  Jedrzej Rybicki authored 3 years ago
  
  8daef8c8
Mar 16, 2022
- check if dags from main are pushed to instance · 90b40fb9
  Christian Boettcher authored 3 years ago
  
  90b40fb9
Mar 14, 2022
- connection id · 7dab1ff6
  Jedrzej Rybicki authored 3 years ago
  
  7dab1ff6
- taskflow update · abbfa9c9
  Jedrzej Rybicki authored 3 years ago
  
  abbfa9c9
Mar 11, 2022
- vault path change · 4af61ce6
  Jedrzej Rybicki authored 3 years ago
  
  4af61ce6
- check testing · 31481e74
  Jedrzej Rybicki authored 3 years ago
  
  31481e74
Mar 10, 2022
- wip: another way of mixing with taskflow · d1d0fe97
  Jedrzej Rybicki authored 3 years ago
  
  d1d0fe97
- wip: towards more flexible conn management · b6b81e31
  Jedrzej Rybicki authored 3 years ago
  
  b6b81e31
Feb 24, 2022
- connnection decorator working both with credentials in request or in vault · 506e73c8
  Jedrzej Rybicki authored 3 years ago
  
  506e73c8
Feb 23, 2022
- no break after missing md field. apparently not so crucial · 007b68d4
  Jedrzej Rybicki authored 3 years ago
  
  007b68d4
- some simple verification of the metadata · 0085b92f
  Jedrzej Rybicki authored 3 years ago
  
  0085b92f
Feb 18, 2022
- updates for new md schema · 69a5a2dd
  Jedrzej Rybicki authored 3 years ago
  
  69a5a2dd
Feb 10, 2022
- modification of taskflow to include datacat backend · ec75b79b
  Christian Boettcher authored 3 years ago
  
  ec75b79b
Dec 16, 2021
- working datacta integration, rough adaption of CI/CD (not finished) · 5f5a6d38
  Christian Boettcher authored 3 years ago
  
  5f5a6d38
Dec 15, 2021
- example of upload flow with md tempalte taken from data catalog · 25a11f3d
  Jedrzej Rybicki authored 3 years ago
  
  25a11f3d
Dec 13, 2021
- connection decorator for #27 " · 5ebc3a67
  Jedrzej Rybicki authored 3 years ago
  
  5ebc3a67
- taskflow with connection decorator · fe17a24d
  Jedrzej Rybicki authored 3 years ago
  
  fe17a24d
- working connection decorator demo · 34c4eef7
  Jedrzej Rybicki authored 3 years ago
  
  34c4eef7
- connection sync DAG with secrets support · fc76e6dd
  Christian Boettcher authored 3 years ago
  
  fc76e6dd
Dec 10, 2021
- first version of connection setup decroator · 20eba40d
  Jedrzej Rybicki authored 3 years ago
  
  20eba40d
Nov 23, 2021
- stream upload · 96d4dca5
  Jedrzej Rybicki authored 3 years ago
  
  96d4dca5
Nov 11, 2021
- example for GA meeting · c012e06a
  Jedrzej Rybicki authored 3 years ago
  
  c012e06a
Nov 10, 2021
- not beutifull yet but works, variable used for common working direcotry, dag... · 90ab8c28
  Jedrzej Rybicki authored 3 years ago
  
  90ab8c28
Nov 02, 2021
- upload to b2share, basic implementation · ea9d985d
  Jedrzej Rybicki authored 3 years ago
  
  ea9d985d
- upload method first version · 65788bc9
  Jedrzej Rybicki authored 3 years ago
  
  65788bc9
Oct 29, 2021
- connection id as parameter · acd41f39
  Jedrzej Rybicki authored 3 years ago
  
  acd41f39
Oct 05, 2021
- ssh key-based access tested and documented · 07915bc3
  Jedrzej Rybicki authored 3 years ago
  
  07915bc3
Oct 04, 2021
- output as DAG parameter and new version of airflow to properly work with ssh keys · abbf29b9
  Jedrzej Rybicki authored 3 years ago
  
  abbf29b9
Sep 16, 2021
- code cleanup · d7b49887
  Jedrzej Rybicki authored 3 years ago
  
  d7b49887
- task name · 5844ec15
  Jedrzej Rybicki authored 3 years ago
  
  5844ec15
- testdag for simple test in ci · 66dd6a4c
  Jedrzej Rybicki authored 3 years ago
  
  66dd6a4c
- test methods · 27452119
  Jedrzej Rybicki authored 3 years ago
  
  27452119
Sep 13, 2021
- fixing tests · f93d1dc3
  Jedrzej Rybicki authored 3 years ago
  
  f93d1dc3
- oid · 954f3448
  Jedrzej Rybicki authored 3 years ago
  
  954f3448