Skip to main content

Topic: #robot-learning

A collection of 12 posts about robot-learning.

From rewards and values to Bellman equations, value and policy iteration, Q-learning, DQN and continuous-action control. Compare the original figures with timestamped transcripts and work through small grids and numerical examples.

43 min read
#robot-learning#reinforcement-learning#q-learning

A guided reading of REINFORCE, baselines and advantages, importance sampling, TRPO, PPO, and SAC, checked against the original slides and public captions. Worked calculations clarify probability ratios, entropy, and loss signs.

38 min read
#robot-learning#reinforcement-learning#policy-gradients

How can a robot remember states that one photograph cannot reveal? From attention, tokens, and position information to CLIP, VLMs, ACT, and FAST, this chapter compares slides with public captions and works through numerical examples.

35 min read
#robot-learning#reinforcement-learning#transformers

What do robots learn, and how do they act? Follow the ETH 2026 lecture slides through policies, imitation learning, reinforcement learning and VLAs, then connect the ideas to working code and simulation examples.

42 min read
#robot-learning#reinforcement-learning#eth-zurich

Follow a robot's goal into physical motion through coordinate frames, inverse kinematics, trajectories and PID control, then build an MDP from states, actions, transitions and rewards. Read the ETH Lecture 2 slides alongside the transcript and a simulation I ran.

69 min read
#robot-learning#reinforcement-learning#robot-control

From behavior cloning to DAgger, multimodal action distributions and latent plans. Follow the original figures and lecture transcripts to distinguish data, loss and execution, then check the ideas with numerical examples.

46 min read
#robot-learning#imitation-learning#behavioral-cloning