Synthetic NIR generation dataset
As mentioned previous overview page, the total dataset is quite large (85GB), downloading via http links may cause Fail connection while downloading. Therefore, we provide 3 download options; via Kaggle API (recommended), Zenodo, and wget.
Image format and precision
All images we provide are 3 channels even for NIR images. In such case, all R, G, B channels hold the samle value. If you want to have a single channel grey scale image, just slicing one of channels. One channel has 8bit precision with *.png image container.
Note
In order to use this option, you need a setup Kaggle API on your computer. Please have a look Kaggle API for detail.
This option is the most reliable based on our experience for large files transaction but it requires to setup your Kaggle API. Please make sure the API is operational by testing a couple of examples from Kaggle API.
nirscene1
Kaggle nirscene1
SEN12MS
Kaggle SEN12MS
capsicum
Kaggle capsicum
We also host our dataset using Zenodo, one of general-purpose open-access repositories. You can find them from the following links
| Dataset | Description | Size (GB) |
|---|---|---|
| nirscene1 | x[10, 100, 200, 400, 600] oversample | 51.88 |
| SEN12MS | Summer, All seasons | 33.29 |
| capsicum | Commercial farms in Australia | 3.03 |
Warning
You may encounter ERROR 403: Forbidden. or Sorry, you can't view or download this file at this time. Too many users have viewed or downloaded this file recently.... errors. This happens due to limited acceess to gdrive and should work within 24 hours but not guranteed. It is thus recommended to use other options in case you download larger files.
You can also directly download from our gdrive with the command below. It is a bit complicated due to cookie business and download speed may be slower than other options.
nirscene1
wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate 'https://docs.google.com/uc?export=download&id=144CRWiVw7QXwm_Q2RSiZuinTwZ3g4LCb' -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')&id=144CRWiVw7QXwm_Q2RSiZuinTwZ3g4LCb" -O nirscene_img_aug_10_oversample_vege_pix2pixHD.tar.gz && rm -rf /tmp/cookies.txt
wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate 'https://docs.google.com/uc?export=download&id=1S4wJL70mVVZZKM3_b2nzJcB61VbKYzT5' -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')&id=1S4wJL70mVVZZKM3_b2nzJcB61VbKYzT5" -O nirscene_img_aug_100_oversample_vege_pix2pixHD.tar.gz && rm -rf /tmp/cookies.txt
wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate 'https://docs.google.com/uc?export=download&id=13NF8Gupb4y0SFIr7NOgU1txJIyKKWYxh' -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')&id=13NF8Gupb4y0SFIr7NOgU1txJIyKKWYxh" -O nirscene_img_aug_200_oversample_vege_pix2pixHD.tar.gz && rm -rf /tmp/cookies.txt
wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate 'https://docs.google.com/uc?export=download&id=1do_yCc-0D3WtKYPkHrsjkA4pi2IaG_el' -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')&id=1do_yCc-0D3WtKYPkHrsjkA4pi2IaG_el" -O nirscene_img_aug_400_oversample_vege_pix2pixHD.tar.gz && rm -rf /tmp/cookies.txt
wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate 'https://docs.google.com/uc?export=download&id=1c1G9qF_JRQN31DD8uW_4Rtlld5N7My4B' -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')&id=1c1G9qF_JRQN31DD8uW_4Rtlld5N7My4B" -O nirscene_img_aug_600_oversample_vege_pix2pixHD.tar.gz && rm -rf /tmp/cookies.txt
SEN12MS
wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate 'https://docs.google.com/uc?export=download&id=1F_FHdN9xQQc-06QuHVRe0bz6igOMWVuq' -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')&id=1F_FHdN9xQQc-06QuHVRe0bz6igOMWVuq" -O sen12ms_SUMMER_pix2pixHD.tar.gz && rm -rf /tmp/cookies.txt
wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate 'https://docs.google.com/uc?export=download&id=1jc-nEZ_zrnQcdPbAwATBpbmEm2ehIivv' -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')&id=1jc-nEZ_zrnQcdPbAwATBpbmEm2ehIivv" -O sen12ms_ALL_pix2pixHD.tar.gz && rm -rf /tmp/cookies.txt
capsicum
wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate 'https://docs.google.com/uc?export=download&id=1DgYnLM3T5SKkjURSl1TgRLaJ87ymX7-0' -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')&id=1DgYnLM3T5SKkjURSl1TgRLaJ87ymX7-0" -O capsicums_pix2pixHD_8_1_1.tar.gz && rm -rf /tmp/cookies.txt
How can I uncompress download files?
We compressed all files in this page as tar.gz format under Ubuntu system. You can use the following command to uncompress them. More detail regarding how to uncompress files can be found from here
You can install 7-zip on your Windows system to uncompress tar.gz files.