... | ... | @@ -22,9 +22,9 @@ Further Contributors: Mehdi Cherti (MC) (Helmholtz AI HLST, JSC) |
|
|
* Initiative's aims are:
|
|
|
- short-term: provide **strong baseline** for pre-training and **transfer learning** for COVID X-Ray diagnostics using large-scale datasets of images from different domains (using both generic datasets like ImageNet and medical imaging datasets like COVIDx - see [Description of available models, codes and datasets](https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_public/sharedspace/playground/covid_xray_deeplearning/wiki/-/blob/master/Description.md))
|
|
|
- **indicate** for the public users (medical doctors, etc) how **certain / uncertain** the performed classification is, given images provided by the users
|
|
|
- **indicate** for the users how strongly the provided images are out-of-distribution, signaling whether pre-trained model is likely not able to produce useful diagnostics on-fly for the given images and potential need for further re-calibration / fine-tuning on the new images before attempting diagnostics
|
|
|
- **indicate** for the users how strongly the provided images are **out-of-distribution**, signaling whether pre-trained model is likely not able to produce useful diagnostics on-fly for the given images and potential need for further re-calibration / fine-tuning on the new images before attempting diagnostics
|
|
|
- **indicate** for the users on which basis the classification was made. e.g by highlighting regions of the input X-Ray image by a heat map or visualizing receptive fields of responsible activations across layers showing which **image regions** or **intermediate features** are **essential for diagnostics decision**
|
|
|
- Long-term vision is a **generic** system digesting different types of image modalities (not only X-Ray - eg. CT and 3D CT scans, including eventually entirely different modalities like PET, MRI, etc), **continually improving** generic model of image understanding (with strong focus on medical diagnostics and analysis of pathological signatures in this frame), allowing **fast transfer** to a specified domain of interest. So, if a new domain X comes up, triggered by an unknown novel pathogen Y causing a disease Z that can be diagnosed via medical imaging, the generic model, **pre-trained on millions of different images from distinct domains**, can be used to derive quickly an expert model for domain X. This should enable quick reaction in face of novel, yet unknown pathologies, where availability of diagnostics is initially impaired.
|
|
|
- Long-term vision is a **generic** system digesting different types of image modalities (not only X-Ray - eg. CT and 3D CT scans, including eventually entirely different modalities like ultrasonography, etc), **continually improving** generic model of image understanding (with strong focus on medical diagnostics and analysis of pathological signatures in this frame), allowing **fast transfer** to a specified domain of interest. So, if a new domain X comes up, triggered by an unknown novel pathogen Y causing a disease Z that can be diagnosed via medical imaging, the generic model, **pre-trained on millions of different images from distinct domains**, can be used to derive quickly an expert model for domain X. This should enable quick reaction in face of novel, yet unknown pathologies, where availability of diagnostics is initially impaired.
|
|
|
|
|
|
#### Potential collaboration directions and topics
|
|
|
Following directions are currently envisaged, please feel free to add more:
|
... | ... | @@ -35,7 +35,7 @@ Following directions are currently envisaged, please feel free to add more: |
|
|
* Uncertainty estimation and signaling (Collaborators: JSC, ...)
|
|
|
* Methods for validation of diagnostics and explainable output (Collaborators: JSC, ...)
|
|
|
* Learning from high resolution images, multi-scale architectures (> 512x512) (Collaborators: JSC, ...)
|
|
|
* Learning from Multi-Modal datasets (e.g, 2D X-Ray or 3D CT scans) (Collaborators: JSC, ...)
|
|
|
* Neural Architecture Search for obtaining higly optimized architecture backbones (Collaborators: JSC, ...)
|
|
|
- Transfer across different hardware architectures (e.g, mobile devices)
|
|
|
* Data collection, preparation, maintenance (Collaborators: JSC (potential link to Juelich Datasets Initiative), HZDR, ...) |
|
|
* Learning from Multi-Modal datasets (e.g, 2D X-Ray, Ultrasound Images, 3D CT scans) (Collaborators: JSC, ...)
|
|
|
* Neural Architecture Search for obtaining highly optimized architecture backbones (Collaborators: JSC, ...)
|
|
|
- Transfer across different hardware architectures (e.g, ultra-low power mobile end devices)
|
|
|
* Data collection, preparation, maintenance (Collaborators: JSC (potential link to Juelich Datasets Initiative), DKRZ, HZDR) |