liqiang
b119135836
Build latest book artifacts / build (push) Canceled after 0s
dependency resolution / resolve (3.11) (push) Canceled after 0s
dependency resolution / resolve (3.13) (push) Canceled after 0s
deploy-pages / build (push) Canceled after 0s
deploy-pages / deploy (push) Canceled after 0s
i18n consistency check / check (push) Canceled after 0s
provider adoption tests / test (chapter2/context-compression) (push) Canceled after 0s
provider adoption tests / test (chapter2/prompt-injection) (push) Canceled after 0s
provider adoption tests / test (chapter2/system-hint) (push) Canceled after 0s
provider adoption tests / test (chapter3/log-sanitization) (push) Canceled after 0s
web-search-agent tests / test (push) Canceled after 0s
web-search-agent tests / agentbook (push) Canceled after 0s
26 lines
5.6 KiB
XML
26 lines
5.6 KiB
XML
<?xml version='1.0' encoding='utf-8'?>
|
|
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 40 780 340" width="780" height="340" style="background:#ffffff">
|
|
<defs><marker id="ah" markerWidth="12" markerHeight="8" refX="12" refY="4" orient="auto"><polygon points="0 0, 12 4, 0 8" fill="#333333" /></marker><marker id="ah-light" markerWidth="12" markerHeight="8" refX="12" refY="4" orient="auto"><polygon points="0 0, 12 4, 0 8" fill="#999999" /></marker></defs>
|
|
|
|
<rect x="40" y="65" width="300" height="130" rx="6" fill="#f0f0f0" stroke="#333333" stroke-width="2" />
|
|
<text x="190" y="88" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="20" fill="#333333" text-anchor="middle" dominant-baseline="central" font-weight="bold">Fase 1: Pemformatan SFT</text>
|
|
<text x="190" y="115" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="14" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">Tujuan: Output dapat di-parse (JSON/tool call)</text>
|
|
<text x="190" y="137" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="13.5" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">Data: Ribuan demonstrasi berkualitas tinggi</text>
|
|
<text x="190" y="159" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="10.5" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">Kondisi henti: Format stabil, kemampuan dasar tercapai</text>
|
|
<text x="190" y="181" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="11.5" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">⚠ Overtraining → Model runtuh ke distribusi pelatihan</text>
|
|
<line x1="342" y1="130" x2="398" y2="130" stroke="#333333" stroke-width="2" marker-end="url(#ah)" />
|
|
<text x="370" y="115" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="14" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">Format</text>
|
|
<text x="370" y="135" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="14" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">Stabil</text>
|
|
<rect x="400" y="65" width="340" height="130" rx="6" fill="#d0d0d0" stroke="#333333" stroke-width="2" />
|
|
<text x="570" y="88" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="20" fill="#333333" text-anchor="middle" dominant-baseline="central" font-weight="bold">Fase 2: Strategi Pembentukan RL</text>
|
|
<text x="570" y="115" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="14" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">Tujuan: Memaksimalkan reward tugas (akurasi/tingkat keberhasilan)</text>
|
|
<text x="570" y="137" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="13" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">Prasyarat: Format output stabil → Reward dapat dihitung</text>
|
|
<text x="570" y="159" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="11" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">Terobosan: Menemukan strategi baru di luar demonstrasi SFT</text>
|
|
<text x="570" y="181" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="11.5" fill="#333333" text-anchor="middle" dominant-baseline="central" font-weight="normal">✓ Format stabil + Jeneralisasi strategi = Siap deployment</text>
|
|
<rect x="40" y="220" width="700" height="70" rx="4" fill="#f5f5f5" stroke="#333333" stroke-width="2" />
|
|
<text x="390" y="238" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="16" fill="#333333" text-anchor="middle" dominant-baseline="central" font-weight="bold">Mengapa kita tidak bisa melewati SFT dan langsung ke RL?</text>
|
|
<text x="390" y="262" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="11" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">Output model dasar tidak terstruktur → Tidak bisa mem-parse JSON → Fungsi reward mengembalikan NaN → Gradien semuanya nol → Pelatihan gagal total</text>
|
|
<text x="390" y="310" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="20" fill="#333333" text-anchor="middle" dominant-baseline="central" font-weight="bold">SFT mengingat distribusi → RL menjeneralisasi strategi</text>
|
|
<text x="390" y="338" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="16" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">SFT: max Σ log P(y|x) (sesuai distribusi pelatihan) RL: max E[R(τ)] (optimasi objektif tugas)</text>
|
|
<text x="390" y="362" font-family="Arial, 'Helvetica Neue', Helvetica, 'PingFang SC', 'Microsoft YaHei', sans-serif" font-size="14" fill="#666666" text-anchor="middle" dominant-baseline="central" font-weight="normal">Saat "sebanyak apa pun demonstrasi ditambahkan, skenario baru tetap berkinerja buruk" → Titik kritis untuk beralih ke RL</text>
|
|
</svg> |