Back to roadmap
6
Fase 6

Deep Learning + GenAI

Neural networks, Transformer, dan LLM API

8 lessons
~99 min baca

Daftar Materi

Fase 6 — Deep Learning + GenAI Preview

Estimasi: 2 minggu (~40 jam dari kelas Dicoding 110 jam — pre-cover ~35%) Prasyarat: Fase 1-5 Tujuan: Bangun intuisi deep learning + transformer + LLM. Saat kelas Dicoding bahas 110 jam, kamu sudah punya mental model.

Strategi

Sama dengan Fase 5: TIDAK perlu pre-cover semua. Yang penting:

  • Intuisi neural network
  • PyTorch basics
  • Konsep transformer
  • Pernah pakai HuggingFace

Sehingga saat kelas dimulai, kamu fokus ke deeper engineering, bukan struggle dengan dasar.

Roadmap

File Topik Estimasi
01-pytorch-basics.md Tensor, autograd, training loop 5 jam
02-neural-networks.md nn.Module, layers, optimizer 6 jam
03-cnn-rnn.md CNN untuk image, RNN untuk seq 5 jam
04-nlp-fundamentals.md Tokenization, embedding, word2vec 4 jam
05-transformer.md Self-attention, multi-head, full transformer 8 jam
06-huggingface.md transformers library, pretrained model 6 jam
07-llm-api.md OpenAI/Anthropic/Gemini API + LLM patterns 6 jam
challenges.md Final challenges -

Tools

pip install torch torchvision transformers datasets accelerate
pip install openai anthropic google-generativeai

Aturan

  1. Wajib tonton Karpathy "Neural Networks: Zero to Hero" — episode 1 minimum
  2. Wajib tonton Karpathy "Let's build GPT" — pre-Fase 5 transformer
  3. Pakai Google Colab kalau laptop tanpa GPU
  4. Bikin akun Hugging Face untuk Fase 6+

📚 Referensi Belajar Fase 6

⭐ Wajib

Resource Tipe Harga
Karpathy — Neural Networks: Zero to Hero 🎥 Video (10+ jam) 🆓
Fast.ai — Practical Deep Learning 🎥 Course 🆓
Hugging Face — NLP Course 📖 + 💻 Course 🆓
Resource Tipe Harga
The Illustrated Transformer 📖 Teks 🆓
The Annotated Transformer 📖 + Code 🆓
PyTorch Official Tutorials 📖 + 💻 🆓
Dive into Deep Learning 📚 Buku interaktif 🆓
Lil'Log — Lilian Weng 📖 Blog 🆓
Deep Learning Specialization (Coursera) 🎥 Course 💰 ~$49/bulan
"Natural Language Processing with Transformers" 📚 Buku 💰 ~$55

Lihat daftar lengkap di RESOURCES.md


Mulai dari: 01-pytorch-basics.md