---
license: apache-2.0
base_model: xlm-roberta-base
tags:
- generated_from_trainer
metrics:
- f1
model-index:
- name: NER-advance
  results: []
datasets:
- unimelb-nlp/wikiann
language:
- en
pipeline_tag: token-classification
---
## NER-Advance
This model is a fine-tuned version of xlm-roberta-base on an unimelb-nlp/wikiann dataset. It achieves the following results on the evaluation set:

• Loss: 0.27204614877700806

• F1: 0.9195951994165037

## Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-5

• train_batch_size: 24

• eval_batch_size: 24

• seed: 42

• weight_decay=0.01

• lr_scheduler_type: linear

• warmup_ratio=0.1

• num_epochs: 2

## Training results

# Training Loss  |  Epoch  |	Validation Loss  |  F1
    0.2895	         1.0		     0.3054	       0.8916

    0.2422	         2.0		     0.2720	       0.9195

## Framework versions

• Transformers 4.38.2

• Pytorch 2.2.1+cu121

• Datasets 2.18.0

• Tokenizers 0.15.2