BERT variant

A BERT variant is a transformer-based language model derived from the original BERT architecture, modified in aspects such as pretraining objectives, architecture, or domain specialization to improve performance on specific tasks or datasets.