@@ -83,42 +83,58 @@ this will displayed in the frontend as well.
...
@@ -83,42 +83,58 @@ this will displayed in the frontend as well.
## 7) Edit notebook.ipynb
## 7) Edit notebook.ipynb
Please edit `notebook.ipynb`. This part is important for the participants. This is given to the participants so that they can
Please edit `notebook.ipynb`. This part is important for the participants. This is given to the participants so that they can have the challlenge introduced to them and be able to easily understand the problem and start to submit easily.
have the challlenge introduced to them and be able to easily understand the problem and start to submit easily.
Steps such as downloading the data, explanation of the problem, exploratory data analysis, baseline solutions, and example submissions
Steps such as downloading the data, explanation of the problem, exploratory data analysis, baseline solutions, and example submissions
should be included.
should be included.
Here is an example of what it could look like: https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_internal/superhaicu/vouchers/j-lich-challenges/challenges/covidx_challenge/-/blob/master/notebook.ipynb
Here is an example of what it could look like: https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_internal/superhaicu/vouchers/j-lich-challenges/challenges/covidx_challenge/-/blob/master/notebook.ipynb
## 8) Edit run.sh
Please edit `run.sh` if needed. This script will make all the archives needed for the challenge. More details are given in `run.sh`.
## 8) Create challenge compressed archives
Here is a short description of the files that `run.sh` need to create:
In order to upload the challenge in the frontend, you need to create the following archives:
-`challenge_config.zip`. This archive contains the challenge configuration, this file will be uploaded at the frontend by yourself
to create the challenge
-`evaluation_script.zip`: contains the contents of the folder `evaluation_script`
-`data_public_leaderboard_phase.zip`. This archive is given to the users for the public leaderboard phase, so you need to upload
-`challenge_config.zip`: contains `evaluation_script.zip`, the folder `annotations/`, the file `challenge_config.yaml`, the folder `templates`, the logo, and optionally the notebook.
it somehwere in a public link.
-`data_private_leaderboard_phase.zip`. This archive is given to the users for the private leaderboard phase, so you need to upload
Here is how the archive contents should look like:
it somehwere in a public link.
```
`run.sh` should work as is, but if you have any a additional files to included in the data archives (such as images), you need to change it.
Archive: challenge_config.zip
When `run.sh` is ready, please run it:
Length Date Time Name
--------- ---------- ----- ----
`./run.sh`
1292 2020-11-20 14:48 evaluation_script.zip
2362 2020-11-20 14:48 challenge_config.yaml
After running the script, you should have these files:
Please also prepare archives that will be distributed to the participants:
-`data_public_leaderboard_phase.zip`. This archive is given to the users for the public leaderboard phase, so you need to upload it somehwere in a public link. This should contain `annotations/train.csv` (public training data) and `annotations/submission_valid.csv` (dummy submission for the validation data) and everything that participants need for training (e.g., images for training or validation data)
-`data_private_leaderboard_phase.zip`. This archive is given to the users for the private leaderboard phase, so you need to upload it somehwere in a public link. This should contain `annotations/valid.csv` (public training data) and `annotations/submission_test.csv` (dummy submission for test data) and everything that participants need for training (e.g., images for training or test data).
Please then upload the data archives in a public link, and point towards the public links
in the HTML files in `templates/` as well as in the `notebook.ipynb`
in the HTML files in `templates/` as well as in the `notebook.ipynb`
## 9) Upload `challenge_config.zip` to the frontend
## 9) Upload `challenge_config.zip` to the frontend
- Go to the frontend
- Go to the frontend
- Create a new challenge, then upload `challenge_config.zip`.
-Click at **Create a new challenge**, then upload `challenge_config.zip`.
This is the last step. One of the administrators should then accept your challenge so that
This is the last step. One of the administrators should then accept your challenge so that
