Commits · 69a5a2ddf6ae69898cd816dae024e12655d8616e · eFlows4HPC WP2 / Data Logistics Service

Feb 18, 2022
- updates for new md schema · 69a5a2dd
  Jedrzej Rybicki authored 3 years ago
  
  69a5a2dd
Feb 10, 2022
- modification of taskflow to include datacat backend · ec75b79b
  Christian Boettcher authored 3 years ago
  
  ec75b79b
Dec 16, 2021
- working datacta integration, rough adaption of CI/CD (not finished) · 5f5a6d38
  Christian Boettcher authored 3 years ago
  
  5f5a6d38
Dec 15, 2021
- example of upload flow with md tempalte taken from data catalog · 25a11f3d
  Jedrzej Rybicki authored 3 years ago
  
  25a11f3d
Dec 13, 2021
- connection decorator for #27 " · 5ebc3a67
  Jedrzej Rybicki authored 3 years ago
  
  5ebc3a67
- taskflow with connection decorator · fe17a24d
  Jedrzej Rybicki authored 3 years ago
  
  fe17a24d
- working connection decorator demo · 34c4eef7
  Jedrzej Rybicki authored 3 years ago
  
  34c4eef7
- connection sync DAG with secrets support · fc76e6dd
  Christian Boettcher authored 3 years ago
  
  fc76e6dd
Dec 10, 2021
- first version of connection setup decroator · 20eba40d
  Jedrzej Rybicki authored 3 years ago
  
  20eba40d
Nov 23, 2021
- stream upload · 96d4dca5
  Jedrzej Rybicki authored 3 years ago
  
  96d4dca5
Nov 11, 2021
- example for GA meeting · c012e06a
  Jedrzej Rybicki authored 3 years ago
  
  c012e06a
Nov 10, 2021
- not beutifull yet but works, variable used for common working direcotry, dag... · 90ab8c28
  Jedrzej Rybicki authored 3 years ago
  
  90ab8c28
Nov 02, 2021
- upload to b2share, basic implementation · ea9d985d
  Jedrzej Rybicki authored 3 years ago
  
  ea9d985d
- upload method first version · 65788bc9
  Jedrzej Rybicki authored 3 years ago
  
  65788bc9
Oct 29, 2021
- connection id as parameter · acd41f39
  Jedrzej Rybicki authored 3 years ago
  
  acd41f39
Oct 05, 2021
- ssh key-based access tested and documented · 07915bc3
  Jedrzej Rybicki authored 3 years ago
  
  07915bc3
Oct 04, 2021
- output as DAG parameter and new version of airflow to properly work with ssh keys · abbf29b9
  Jedrzej Rybicki authored 3 years ago
  
  abbf29b9
Sep 16, 2021
- code cleanup · d7b49887
  Jedrzej Rybicki authored 3 years ago
  
  d7b49887
- task name · 5844ec15
  Jedrzej Rybicki authored 3 years ago
  
  5844ec15
- testdag for simple test in ci · 66dd6a4c
  Jedrzej Rybicki authored 3 years ago
  
  66dd6a4c
- test methods · 27452119
  Jedrzej Rybicki authored 3 years ago
  
  27452119
Sep 13, 2021
- fixing tests · f93d1dc3
  Jedrzej Rybicki authored 3 years ago
  
  f93d1dc3
- oid · 954f3448
  Jedrzej Rybicki authored 3 years ago
  
  954f3448
- b2share operator using more airflowish hook · d582f3a3
  Jedrzej Rybicki authored 3 years ago
  
  d582f3a3
Sep 07, 2021
- same workflow now without taskflow · 2bfd066b
  Jedrzej Rybicki authored 3 years ago
  
  2bfd066b
Sep 06, 2021
- ssh connection setup and test · 77631454
  Jedrzej Rybicki authored 3 years ago
  
  77631454
Aug 31, 2021
- wip: ssh to the target · 810c16d6
  Jedrzej Rybicki authored 3 years ago
  
  810c16d6
- passing oid as parameter check #4 · 36c12439
  Jedrzej Rybicki authored 3 years ago
  
  36c12439
Aug 27, 2021
- working stub · ca996331
  Jedrzej Rybicki authored 3 years ago
  
  ca996331
- urllib fix · b3d0f962
  Jedrzej Rybicki authored 3 years ago
  
  b3d0f962
- etl scaffolding · dcec1a4d
  Jedrzej Rybicki authored 3 years ago
  
  dcec1a4d
- further testing of dag params · e5eade13
  Jedrzej Rybicki authored 3 years ago
  
  e5eade13
Aug 26, 2021
- uri · 13c537c4
  Jedrzej Rybicki authored 3 years ago
  
  13c537c4
- con management · fe9a9d54
  Jedrzej Rybicki authored 3 years ago
  
  fe9a9d54
- cons · 1d682e3d
  Jedrzej Rybicki authored 3 years ago
  
  1d682e3d
- reqs · 8c1f4376
  Jedrzej Rybicki authored 3 years ago
  
  8c1f4376
- yolo · b1020f13
  Jedrzej Rybicki authored 3 years ago
  
  b1020f13
Aug 20, 2021
- simple dag for tests · 043d0930
  Jedrzej Rybicki authored 3 years ago
  
  043d0930