Talk given at the AAAI 2025 Tutorial on Foundation Models Meet Embodied Agents: https://foundation-models-meet-embodied-agents.github.io/