SIONlib issueshttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues2019-12-02T16:03:57+01:00https://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/119Compatibility for OmpSs2019-12-02T16:03:57+01:00Kay ThustCompatibility for OmpSsIntegration of an additional parallel API driver layer for OmpSs. This will extend the list of currently supported parallel paradigms (MPI, OMP, hybrid)Integration of an additional parallel API driver layer for OmpSs. This will extend the list of currently supported parallel paradigms (MPI, OMP, hybrid)DEEP-ERhttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/115Add platform library for adapting SIONlib's behavior to the platform it runs on2019-04-12T14:16:26+02:00Kay ThustAdd platform library for adapting SIONlib's behavior to the platform it runs onFormally known as hardware libFormally known as hardware libWolfgang FringsWolfgang Fringshttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/114Add merge mode for collective write2015-03-10T17:43:15+01:00Kay ThustAdd merge mode for collective writev1.6Wolfgang FringsWolfgang Fringshttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/113Optimization for Scalasca2015-03-25T11:02:34+01:00Kay ThustOptimization for Scalasca- investigation on currently poor I/O performance- investigation on currently poor I/O performancev1.6Wolfgang FringsWolfgang Fringshttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/110Check debug levels and usage of DFUNCTION2019-12-02T16:03:57+01:00Kay ThustCheck debug levels and usage of DFUNCTIONhttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/109SION_DEBUG=stdout does not work2015-03-10T17:35:21+01:00Wolfgang FringsSION_DEBUG=stdout does not workSION_DEBUG=stdout does not work: is writes to a file instead to stdoutSION_DEBUG=stdout does not work: is writes to a file instead to stdoutv1.6Wolfgang FringsWolfgang Fringshttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/108sionsplit and sioncat should support key-value2019-12-02T16:03:56+01:00Wolfgang Fringssionsplit and sioncat should support key-valuesionsplit and sioncat should support key-value by creating one file per keysionsplit and sioncat should support key-value by creating one file per keyv1.6https://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/103Problems with POSIX I/O and buffering2019-12-02T16:03:56+01:00Wolfgang FringsProblems with POSIX I/O and bufferingFrom John Donners:
I've also experimented a lot with the POSIX interface and the internal
buffering for SIONlib. The SIONlib buffer seems not flushed at the
moment that the file is closed. I've added an extra routine to flush the
buffer...From John Donners:
I've also experimented a lot with the POSIX interface and the internal
buffering for SIONlib. The SIONlib buffer seems not flushed at the
moment that the file is closed. I've added an extra routine to flush the
buffer, which uses the same code as in sion_fwrite. I'm not sure where
to insert the code in the different SIONlib close calls.v1.6https://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/102Polish the header creation of replacement definitions2019-12-02T16:03:56+01:00Kay ThustPolish the header creation of replacement definitionsAdd tests and integrate into dist process.Add tests and integrate into dist process.v1.6https://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/97check for more use of 'const' where possible2019-12-02T16:03:56+01:00Kay Thustcheck for more use of 'const' where possiblePointer arguments should be `const` wherever possible.Pointer arguments should be `const` wherever possible.https://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/90All console output should also be shown in debug messages2019-12-02T16:03:56+01:00Kay ThustAll console output should also be shown in debug messagesFor example output of `_sion_errorprint` should be shown in in debug to get a consistent order of all output.For example output of `_sion_errorprint` should be shown in in debug to get a consistent order of all output.v1.6https://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/88Use collective writes with neglecting the original writer2014-10-29T18:00:14+01:00Kay ThustUse collective writes with neglecting the original writerFeature request for NEST:
The data is always self describing so it would be beneficial not to keep track on where the data originated from.
- All write requests passed to the collector should just be written contiguously in the order t...Feature request for NEST:
The data is always self describing so it would be beneficial not to keep track on where the data originated from.
- All write requests passed to the collector should just be written contiguously in the order the collector receives them.
- The chunks of the senders hence stay empty.
See **merge mode** in [doc/inputs/collective.dox](doc/inputs/collective.dox) or the corresponding page processed by doxygen.v1.6Wolfgang FringsWolfgang Fringshttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/84sion_dup2014-10-29T17:59:39+01:00Wolfgang Fringssion_dupBei den Funktionen
int _sion_dup(int sid, int mode, int rank, uint64_t key);
int _sion_dedup( int sid );
werden derzeit die Datenstrukturen komplett kopiert. rank und key
werden noch nicht beachtet.
Zur Optimierung (Score-P, S...Bei den Funktionen
int _sion_dup(int sid, int mode, int rank, uint64_t key);
int _sion_dedup( int sid );
werden derzeit die Datenstrukturen komplett kopiert. rank und key
werden noch nicht beachtet.
Zur Optimierung (Score-P, Scalasca) wäre das aber nötig.v1.6Wolfgang FringsWolfgang Fringshttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/82build python interface2019-12-02T16:03:56+01:00Kay Thustbuild python interfacesionconfig needs additional information: pythonpath, pythonversionsionconfig needs additional information: pythonpath, pythonversionhttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/80Error codes for unsuccessful read / write calls2021-08-25T15:20:43+02:00Kay ThustError codes for unsuccessful read / write callsreported by Bert Wesarg
> Das Problem ist wohl eher, das wir gerne zw. 'erfolgreichem lesen, auch wenn es zu wenig war' und 'fehler beim lesen' untscheiden wollen. Mit der ASNI API kann man das gut mit ferror() unterscheiden. Aber bei s...reported by Bert Wesarg
> Das Problem ist wohl eher, das wir gerne zw. 'erfolgreichem lesen, auch wenn es zu wenig war' und 'fehler beim lesen' untscheiden wollen. Mit der ASNI API kann man das gut mit ferror() unterscheiden. Aber bei sion_fread_key() sehe ich da jetzt nicht eine moeglichkeit.
Und später
> Auch bei ANSI kann man anhand des Rükgabewertes nicht entscheiden, ob es ein error oder ein end-of-file ist. Ob nun die Anzahl der Bytes oder der Elemente zurück gegeben werden, spielt da keine Rolle. Ich sehe also gerade nicht, wie diese Information vorher verfügbar hätte sein könnte. POSIX auf der anderen Seite gibt einem -1 wieder, in Falle eines Fehlers.2.0.0https://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/75Add new layer above read and write to support continuous read and write2021-08-25T15:20:43+02:00Kay ThustAdd new layer above read and write to support continuous read and write2.0.0https://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/71Handling of SION_BUFFERSIZE2019-12-02T16:03:56+01:00Wolfgang FringsHandling of SION_BUFFERSIZEInterestingly enough, the POSIX open
call does not show this behaviour. So I changed to the POSIX interface.
To get the buffering, I also added the 'buffered' option when opening the
file. Is that option mature enough for production? I j...Interestingly enough, the POSIX open
call does not show this behaviour. So I changed to the POSIX interface.
To get the buffering, I also added the 'buffered' option when opening the
file. Is that option mature enough for production? I just have one remark:
I had to set the environment variable SION_BUFFERSIZE to actually get
the buffering to work. I think that is because of line 60 in sion_buffer.c, which
shouldn't be inside the if-construct, so the buffer size gets set to the block size
by default. v1.6https://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/69Add keyval feature to SIONlib2014-10-16T18:56:27+02:00Wolfgang FringsAdd keyval feature to SIONlibThis ticket is a container for open issues for keyval featureThis ticket is a container for open issues for keyval featurev1.6Wolfgang FringsWolfgang Fringshttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/63Download-Panel HTML-Problems2019-04-12T14:18:59+02:00Wolfgang FringsDownload-Panel HTML-ProblemsWolfgang FringsWolfgang Fringshttps://gitlab.jsc.fz-juelich.de/cstao-public/SIONlib/SIONlib/-/issues/38Optimize internal data strucure2014-10-29T17:43:01+01:00Wolfgang FringsOptimize internal data strucureSome vectors in the SIONlib internal data structure should be defined as sion_int32 instead sion_int64:
-> all_globalranks
-> all_localranks
-> all_blockcount
This is also a change to the file format!
Some vectors in the SIONlib internal data structure should be defined as sion_int32 instead sion_int64:
-> all_globalranks
-> all_localranks
-> all_blockcount
This is also a change to the file format!
v1.6Wolfgang FringsWolfgang Frings