UAVid++: Higher-Quality Labels and Expanded Semantic Taxonomy for Aerial Semantic Segmentation

Department of Computer Science, Technical University of Cluj-Napoca, Romania

Accepted to IEEE Transactions on Geoscience and Remote Sensing (TGRS), 2026

TLDR: Refined labels, an expanded taxonomy, a more discriminative benchmark, and a baseline for aerial semantic segmentation.

Abstract

High-quality annotated datasets are critical for semantic segmentation, particularly in aerial imagery, where the number of manually annotated frames is limited and precise labeling is often missing. To address this, we introduce UAVid++, a semantically refined and expanded version of the UAVid dataset for aerial semantic segmentation. The proposed dataset provides higher-quality annotations through manual corrections addressing labeling errors across the entire original UAVid dataset. In addition, we expand the taxonomy with three finely annotated semantic classes, Water, Sky, and Roof, selected to enrich the semantic space and separate visually distinct objects previously grouped together under the same label. We evaluated state-of-the-art aerial segmentation methods on UAVid, UAVid+ (with corrections, without expanded taxonomy), and the full UAVid++ dataset. Corrected annotations improved both training and evaluation performance by up to 7.4% mIoU, and adding the three classes further increased performance by up to 4.1%, demonstrating the combined impact of refined labels and the expanded semantic taxonomy. UAVid++ enables more discriminative evaluation of state-of-the-art methods and improves their relative ranking. We adapt frozen DINO-pretrained ViT backbones using trainable task-specific heads for UAV semantic segmentation. This strategy achieves strong segmentation performance and robust generalization while quantifying the gains from improved labels relative to pretrained backbone capacity. Relative to the best-performing state-of-the-art method, our configurations achieve a 2.7% mIoU improvement on UAVid++, up to 12.4% mIoU gains on out-of-distribution UAV datasets, and a 38.85% mIoU gain on a cross-domain dataset.

Contributions

Refined and expanded dataset

Labeling errors and coarse contours are manually corrected across the entire UAVid dataset, and the taxonomy is expanded from 8 to 11 classes to improve semantic separability and reduce unlabeled regions.

A more informative benchmark

Five state-of-the-art methods re-trained and re-evaluated on every variant, where corrections alone add up to +7.4% mIoU and the expanded taxonomy a further +4.1%. They cluster near 69% mIoU on the original UAVid, but UAVid++ produces a wider distribution of scores and improves their relative ranking.

DINO ViT adaptation strategy

Lightweight trainable heads on a frozen DINO-pretrained ViT backbone reach 82.04% mIoU on UAVid++, +2.7% over the best state-of-the-art method. They also generalize well, gaining up to +12.4% on unseen UAV datasets and +38.85% on cross-domain satellite imagery.

Quantifying labels vs backbone capacity

Better labels are worth +9.2% mIoU, while scaling the frozen backbone from 840M to 6.7B parameters yields only +0.6%. For aerial imagery, where annotated data is limited, label quality matters far more than backbone size.

UAVid, UAVid+ and UAVid++ annotations with segmentation performance across the three variants.

UAVid, UAVid+ and UAVid++ annotations with segmentation performance across the three variants.

The Dataset

Two new variants derived from the same 420 annotated frames of UAVid, so corrections and the expanded taxonomy can be measured separately.

baseline

UAVid

The original oblique-view aerial dataset with 8 semantic classes.

corrected

UAVid+

Corrected annotations only, across the same 8 categories as UAVid.

corrected and expanded

UAVid++

Corrected annotations and new classes. Water, Sky and Roof are added to the refined labels, bringing the taxonomy to 11 categories.

The 11-class semantic taxonomy

Background Clutter
Building (Wall)
Road
Tree
Low Vegetation
Dynamic Car
Static Car
Human

Water NEW

All visible water surfaces, regardless of reflectance. Objects in the water keep their own class down to the waterline, and wet ground without pooling is not Water.

Sky NEW

All visible sky, including clouds and haze. Backlit objects keep their own label up to their visible outline.

Roof NEW

All upper surfaces of a building, plus roof-mounted equipment such as air-conditioning units and solar panels.

Adapting DINO ViTs

The DINO-pretrained ViT backbone stays frozen and only a lightweight head is trained on top.

head (i)

Linear probing

A single layer mapping frozen features directly to the semantic label space. With ViT-H+ it adds only ~15.3K trainable parameters.

head (ii)

Convolutional

Two sequential Conv-BatchNorm-ReLU blocks, the second halving channels. ~22M parameters when coupled with ViT-H+.

head (iii)

UNet-inspired

Three downsampling stages, a C/16 bottleneck, three upsampling stages and skip connections. ~26M parameters with ViT-H+.

Backbones: ViT-L (300M) · ViT-g (1.1B) · ViT-H+ (840M) · ViT-7B (6.7B) Loss: weighted Cross-Entropy + Dice + weighted Boundary-Aware Pretraining: web-scale only (DINOv3 on LVD-1689M)

Benchmark

In-distribution results across the three variants. Corrected labels and the expanded taxonomy lift every method, and change how they rank against each other.

Tables II & III - In-distribution results on UAVid, UAVid+ and UAVid++ (mIoU %). Cross-evaluation between UAVid and UAVid+ exposes annotation issues in the original training and test splits; UAVid++ adds further gains through its expanded taxonomy. Green values indicate gains over UAVid.

TrainTest State of the art Ours - frozen DINO ViT + trainable head
UNetFormerLWGANetSFA-NetLSKNetD2LS ViT-g
UNet
ViT-H+
Linear
ViT-H+
Conv
ViT-H+
UNet
ViT-7B
UNet
UAVidUAVid 67.8769.1869.5269.0369.68 71.9163.1772.0372.2372.82
UAVidUAVid+ 70.38 2.572.33 3.172.64 3.172.65 3.672.72 3.0 75.02 3.165.95 2.875.34 3.375.74 3.576.26 3.4
UAVid+UAVid 68.3868.0170.1670.6370.94 72.7063.1972.5673.3073.45
UAVid+UAVid+ 72.83 5.073.52 4.375.85 6.376.44 7.476.96 7.3 77.83 5.966.29 3.177.96 5.978.67 6.479.41 6.6
UAVid++UAVid++ 75.07 7.277.66 8.578.43 8.978.61 9.679.35 9.7 80.68 8.870.13 6.980.86 8.881.42 9.282.04 9.2

LSKNet ranks fourth of five on the original UAVid but second on both corrected variants, so annotation quality changes how these methods rank against each other. On UAVid++ the best configuration beats the strongest state-of-the-art method by 2.7% mIoU (82.04 vs. 79.35). Growing the frozen backbone from ViT-H+ (840M) to ViT-7B (6.7B) is worth only ~0.6%, against 9.2% from improving the data alone.

Generalization

Trained only on UAVid++ and evaluated without any retraining on unseen UAV datasets and on high-altitude aerial and satellite imagery.

Tables VII & VIII - Generalization without retraining (mIoU %). UDD and VDD are unseen UAV datasets; OpenEarthMap is high-altitude aerial and satellite imagery under a severe domain shift. Green values indicate gains over D2LS (SOTA).

Test setMethodmIoU
UDDD2LS55.46
ViT-H+ Linear64.58 9.1
ViT-H+ UNet67.89 12.4
VDDD2LS60.14
ViT-H+ Linear65.98 5.8
ViT-H+ UNet69.00 8.9
OpenEarthMapD2LS24.1
ViT-H+ UNet62.95 38.85

Get the Release

The dataset and the implementation are publicly released for reproducibility and further research.

License

UAVid++ is derived from the UAVid dataset and, in accordance with the ShareAlike terms of UAVid's license, is released under the same Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY-NC-SA 4.0). This website was adapted from the Nerfies project page.

BibTeX Citation

@article{chiciudean2026uavidplusplus,
  author={Chiciudean, Vivian and Nedevschi, Sergiu and Oniga, Florin},
  journal={IEEE Transactions on Geoscience and Remote Sensing}, 
  title={UAVid++: Higher-Quality Labels and Expanded Semantic Taxonomy for Aerial Semantic Segmentation}, 
  year={2026},
  volume={},
  number={},
  pages={1-1},
  doi={10.1109/TGRS.2026.3715191}}

Acknowledgments

This work was supported by the Romanian Hub for Artificial Intelligence – HRIA project, Smart Growth, Digitization and Financial Instruments Program, MySMIS no. 351416, Ministry of Investments and European Projects, Romanian Government.