Commits · 4107b26f286d132dfb83623c35d08d9308b224b4 · eFlows4HPC WP2 / Data Logistics Service

Apr 07, 2022
- bash based download · 4107b26f
  Jedrzej Rybicki authored 2 years ago
  
  4107b26f
Apr 06, 2022
- working with datacat hook · 03cb6f4e
  Jedrzej Rybicki authored 2 years ago
  
  03cb6f4e
Apr 05, 2022
- read the code first · f4bdf0ae
  Jedrzej Rybicki authored 2 years ago
  
  f4bdf0ae
- md from data cat · 44836fac
  Jedrzej Rybicki authored 2 years ago
  
  44836fac
- reg with md retrieval · a59e2604
  Jedrzej Rybicki authored 2 years ago
  
  a59e2604
- registration with datacat hook · 10d7f8d6
  Jedrzej Rybicki authored 2 years ago
  
  10d7f8d6
- registration with hook. testing · f0e4fad9
  Jedrzej Rybicki authored 2 years ago
  
  f0e4fad9
- mmore verbose b2share con handling · d0f64577
  Jedrzej Rybicki authored 2 years ago
  
  d0f64577
Apr 01, 2022
- optional registration in upload · f5100d28
  Jedrzej Rybicki authored 2 years ago
  
  f5100d28
Mar 24, 2022
- image transfer dag · b18868b7
  Jedrzej Rybicki authored 3 years ago
  
  b18868b7
Mar 23, 2022
- mkdir p on target · 8bfabd2c
  Jedrzej Rybicki authored 3 years ago
  
  8bfabd2c
- directory making for upload, and removal temp files for registration · 5ccb37b5
  Jedrzej Rybicki authored 3 years ago
  
  5ccb37b5
- host, user, port now comes as pipelines parameters · 7d34227f
  Jedrzej Rybicki authored 3 years ago
  
  7d34227f
Mar 22, 2022
- default host ist bsc now · af9aab12
  Jedrzej Rybicki authored 3 years ago
  
  af9aab12
- secret path in vault · 8daef8c8
  Jedrzej Rybicki authored 3 years ago
  
  8daef8c8
Mar 16, 2022
- check if dags from main are pushed to instance · 90b40fb9
  Christian Boettcher authored 3 years ago
  
  90b40fb9
Mar 14, 2022
- connection id · 7dab1ff6
  Jedrzej Rybicki authored 3 years ago
  
  7dab1ff6
- taskflow update · abbfa9c9
  Jedrzej Rybicki authored 3 years ago
  
  abbfa9c9
Mar 11, 2022
- vault path change · 4af61ce6
  Jedrzej Rybicki authored 3 years ago
  
  4af61ce6
- check testing · 31481e74
  Jedrzej Rybicki authored 3 years ago
  
  31481e74
Mar 10, 2022
- wip: another way of mixing with taskflow · d1d0fe97
  Jedrzej Rybicki authored 3 years ago
  
  d1d0fe97
- wip: towards more flexible conn management · b6b81e31
  Jedrzej Rybicki authored 3 years ago
  
  b6b81e31
Feb 24, 2022
- connnection decorator working both with credentials in request or in vault · 506e73c8
  Jedrzej Rybicki authored 3 years ago
  
  506e73c8
Feb 23, 2022
- no break after missing md field. apparently not so crucial · 007b68d4
  Jedrzej Rybicki authored 3 years ago
  
  007b68d4
- some simple verification of the metadata · 0085b92f
  Jedrzej Rybicki authored 3 years ago
  
  0085b92f
Feb 18, 2022
- updates for new md schema · 69a5a2dd
  Jedrzej Rybicki authored 3 years ago
  
  69a5a2dd
Feb 10, 2022
- modification of taskflow to include datacat backend · ec75b79b
  Christian Boettcher authored 3 years ago
  
  ec75b79b
Dec 16, 2021
- working datacta integration, rough adaption of CI/CD (not finished) · 5f5a6d38
  Christian Boettcher authored 3 years ago
  
  5f5a6d38
Dec 15, 2021
- example of upload flow with md tempalte taken from data catalog · 25a11f3d
  Jedrzej Rybicki authored 3 years ago
  
  25a11f3d
Dec 13, 2021
- connection decorator for #27 " · 5ebc3a67
  Jedrzej Rybicki authored 3 years ago
  
  5ebc3a67
- taskflow with connection decorator · fe17a24d
  Jedrzej Rybicki authored 3 years ago
  
  fe17a24d
- working connection decorator demo · 34c4eef7
  Jedrzej Rybicki authored 3 years ago
  
  34c4eef7
- connection sync DAG with secrets support · fc76e6dd
  Christian Boettcher authored 3 years ago
  
  fc76e6dd
Dec 10, 2021
- first version of connection setup decroator · 20eba40d
  Jedrzej Rybicki authored 3 years ago
  
  20eba40d
Nov 23, 2021
- stream upload · 96d4dca5
  Jedrzej Rybicki authored 3 years ago
  
  96d4dca5
Nov 11, 2021
- example for GA meeting · c012e06a
  Jedrzej Rybicki authored 3 years ago
  
  c012e06a
Nov 10, 2021
- not beutifull yet but works, variable used for common working direcotry, dag... · 90ab8c28
  Jedrzej Rybicki authored 3 years ago
  
  90ab8c28
Nov 02, 2021
- upload to b2share, basic implementation · ea9d985d
  Jedrzej Rybicki authored 3 years ago
  
  ea9d985d
- upload method first version · 65788bc9
  Jedrzej Rybicki authored 3 years ago
  
  65788bc9
Oct 29, 2021
- connection id as parameter · acd41f39
  Jedrzej Rybicki authored 3 years ago
  
  acd41f39