Build latest book artifacts / build (push) Canceled after 0s
dependency resolution / resolve (3.11) (push) Canceled after 0s
dependency resolution / resolve (3.13) (push) Canceled after 0s
deploy-pages / build (push) Canceled after 0s
deploy-pages / deploy (push) Canceled after 0s
i18n consistency check / check (push) Canceled after 0s
provider adoption tests / test (chapter2/context-compression) (push) Canceled after 0s
provider adoption tests / test (chapter2/prompt-injection) (push) Canceled after 0s
provider adoption tests / test (chapter2/system-hint) (push) Canceled after 0s
provider adoption tests / test (chapter3/log-sanitization) (push) Canceled after 0s
web-search-agent tests / test (push) Canceled after 0s
web-search-agent tests / agentbook (push) Canceled after 0s
21 lines
592 B
Plaintext
21 lines
592 B
Plaintext
# Korean Mistral Continued Pretraining Requirements
|
|
# Install with: pip install -r requirements.txt
|
|
|
|
# Core dependencies
|
|
torch>=2.0.0
|
|
transformers>=4.36.0
|
|
datasets>=2.14.0
|
|
accelerate>=0.25.0
|
|
|
|
# Unsloth for efficient training
|
|
unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git
|
|
|
|
# Optional but recommended
|
|
wandb>=0.16.0 # For experiment tracking
|
|
bitsandbytes>=0.41.0 # For 4-bit quantization
|
|
scipy>=1.11.0 # For certain optimizations
|
|
|
|
# Note: For Google Colab, use this installation instead:
|
|
# !pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
|
|
|