Llama Token Cls

wandb-examplescolabspeft

Open In Colab

📦 Packages and Basic Setup


To run the notebooks you'll need two secrets named W&B and HF_TOKEN. Also, in the configuration section change the wandb_entity to your username/workspace.

[ ]
[ ]
[ ]
[ ]
[ ]

💿 The Dataset


[ ]
[ ]

🖖 Utility Functions


[ ]

🏠 Model Architecture


Implementating LlamaForTokenClassification

Source: @KoichiYasuoka

[ ]

Process Dataset for Token Classification

[ ]

Obtaining 🤗 PEFT Model

[ ]

✍️ Training


[ ]
[ ]