|
## Helmholtz AI COVIDNet X Initiative
|
|
## Helmholtz AI COVIDNetX Initiative
|
|
|
|
|
|
### Transferable Deep Learning for fast COVID X-Ray detection and explainable diagnostics
|
|
### Transferable Deep Learning for fast COVID X-Ray detection and explainable diagnostics
|
|
|
|
|
... | @@ -19,6 +19,7 @@ Further Contributors: Mehdi Cherti (MC) (Helmholtz AI HLST, JSC) |
... | @@ -19,6 +19,7 @@ Further Contributors: Mehdi Cherti (MC) (Helmholtz AI HLST, JSC) |
|
* Initiative's aims are:
|
|
* Initiative's aims are:
|
|
- short-term: provide **strong baseline** for pre-training and **transfer learning** for COVID X-Ray diagnostics using large-scale datasets of images from different domains (using both generic datasets like ImageNet and medical imaging datasets like COVIDx - see [Description of available models, codes and datasets](https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_public/sharedspace/playground/covid_xray_deeplearning/wiki/-/blob/master/Description.md))
|
|
- short-term: provide **strong baseline** for pre-training and **transfer learning** for COVID X-Ray diagnostics using large-scale datasets of images from different domains (using both generic datasets like ImageNet and medical imaging datasets like COVIDx - see [Description of available models, codes and datasets](https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_public/sharedspace/playground/covid_xray_deeplearning/wiki/-/blob/master/Description.md))
|
|
- **indicate** for the public users (medical doctors, etc) how **certain / uncertain** the performed classification is, given images provided by the users
|
|
- **indicate** for the public users (medical doctors, etc) how **certain / uncertain** the performed classification is, given images provided by the users
|
|
|
|
- **indicate** for the users how strongly the provided images are out-of-distribution, signaling whether pre-trained model is likely not able to produce useful diagnostics on-fly for the given images and potential need for further re-calibration / fine-tuning on the new images before attempting diagnostics
|
|
- **indicate** for the users on which basis the classification was made. e.g by highlighting regions of the input X-Ray image by a heat map or visualizing receptive fields of responsible activations across layers showing which **image regions** or **intermediate features** are **essential for diagnostics decision**
|
|
- **indicate** for the users on which basis the classification was made. e.g by highlighting regions of the input X-Ray image by a heat map or visualizing receptive fields of responsible activations across layers showing which **image regions** or **intermediate features** are **essential for diagnostics decision**
|
|
- Long-term vision is a **generic** system digesting different types of image modalities (not only X-Ray - eg. CT and 3D CT scans, including eventually entirely different modalities like PET, MRI, etc), **continually improving** generic model of image understanding (with strong focus on medical diagnostics and analysis of pathological signatures in this frame), allowing **fast transfer** to a specified domain of interest. So, if a new domain X comes up, triggered by an unknown novel pathogen Y causing a disease Z that can be diagnosed via medical imaging, the generic model, **pre-trained on millions of different images from distinct domains**, can be used to derive quickly an expert model for domain X. This should enable quick reaction in face of novel, yet unknown pathologies, where availability of diagnostics is initially impaired.
|
|
- Long-term vision is a **generic** system digesting different types of image modalities (not only X-Ray - eg. CT and 3D CT scans, including eventually entirely different modalities like PET, MRI, etc), **continually improving** generic model of image understanding (with strong focus on medical diagnostics and analysis of pathological signatures in this frame), allowing **fast transfer** to a specified domain of interest. So, if a new domain X comes up, triggered by an unknown novel pathogen Y causing a disease Z that can be diagnosed via medical imaging, the generic model, **pre-trained on millions of different images from distinct domains**, can be used to derive quickly an expert model for domain X. This should enable quick reaction in face of novel, yet unknown pathologies, where availability of diagnostics is initially impaired.
|
|
|
|
|
... | | ... | |