Back to roadmap
6
Fase 6
Deep Learning + GenAI
Neural networks, Transformer, dan LLM API
8 lessons
~99 min baca
Daftar Materi
Fase 6 — Deep Learning + GenAI Preview
Estimasi: 2 minggu (~40 jam dari kelas Dicoding 110 jam — pre-cover ~35%) Prasyarat: Fase 1-5 Tujuan: Bangun intuisi deep learning + transformer + LLM. Saat kelas Dicoding bahas 110 jam, kamu sudah punya mental model.
Strategi
Sama dengan Fase 5: TIDAK perlu pre-cover semua. Yang penting:
- Intuisi neural network
- PyTorch basics
- Konsep transformer
- Pernah pakai HuggingFace
Sehingga saat kelas dimulai, kamu fokus ke deeper engineering, bukan struggle dengan dasar.
Roadmap
| File | Topik | Estimasi |
|---|---|---|
| 01-pytorch-basics.md | Tensor, autograd, training loop | 5 jam |
| 02-neural-networks.md | nn.Module, layers, optimizer | 6 jam |
| 03-cnn-rnn.md | CNN untuk image, RNN untuk seq | 5 jam |
| 04-nlp-fundamentals.md | Tokenization, embedding, word2vec | 4 jam |
| 05-transformer.md | Self-attention, multi-head, full transformer | 8 jam |
| 06-huggingface.md | transformers library, pretrained model | 6 jam |
| 07-llm-api.md | OpenAI/Anthropic/Gemini API + LLM patterns | 6 jam |
| challenges.md | Final challenges | - |
Tools
pip install torch torchvision transformers datasets accelerate
pip install openai anthropic google-generativeai
Aturan
- Wajib tonton Karpathy "Neural Networks: Zero to Hero" — episode 1 minimum
- Wajib tonton Karpathy "Let's build GPT" — pre-Fase 5 transformer
- Pakai Google Colab kalau laptop tanpa GPU
- Bikin akun Hugging Face untuk Fase 6+
📚 Referensi Belajar Fase 6
⭐ Wajib
| Resource | Tipe | Harga |
|---|---|---|
| Karpathy — Neural Networks: Zero to Hero | 🎥 Video (10+ jam) | 🆓 |
| Fast.ai — Practical Deep Learning | 🎥 Course | 🆓 |
| Hugging Face — NLP Course | 📖 + 💻 Course | 🆓 |
Recommended
| Resource | Tipe | Harga |
|---|---|---|
| The Illustrated Transformer | 📖 Teks | 🆓 |
| The Annotated Transformer | 📖 + Code | 🆓 |
| PyTorch Official Tutorials | 📖 + 💻 | 🆓 |
| Dive into Deep Learning | 📚 Buku interaktif | 🆓 |
| Lil'Log — Lilian Weng | 📖 Blog | 🆓 |
| Deep Learning Specialization (Coursera) | 🎥 Course | 💰 ~$49/bulan |
| "Natural Language Processing with Transformers" | 📚 Buku | 💰 ~$55 |
Lihat daftar lengkap di RESOURCES.md
Mulai dari: 01-pytorch-basics.md