Tuesday 20 August 2024

Show HN: Open-source fine-tuning in a Colab notebook https://bit.ly/4fLVIHP

Show HN: Open-source fine-tuning in a Colab notebook Posted before, but wanted to share if you want an open source alternative to OpenAI fine-tuning, give Unsloth a try! Phi 3.5 was just released, and is distilled from GPT4. Unsloth makes finetuning 2x faster, uses 70% less VRAM + has no accuracy degradations. We rewrite all backprop steps and reduce FLOPs and write everything in Triton (JIT low level CUDA). If you want to own the weights after fine-tuning, give Unsloth a spin! I have free Colabs and Kaggle notebooks as well at https://bit.ly/46VObR7 https://bit.ly/3WWhBeQ August 21, 2024 at 02:34AM

No comments:

Post a Comment