  This survey presents an overview of methods for learning from video (LfV) in
the context of reinforcement learning (RL) and robotics. We focus on methods
capable of scaling to large internet video datasets and, in the process,
extracting foundational knowledge about the world's dynamics and physical human
behaviour. Such methods hold great promise for developing general-purpose
robots.
  We open with an overview of fundamental concepts relevant to the
LfV-for-robotics setting. This includes a discussion of the exciting benefits
LfV methods can offer (e.g., improved generalization beyond the available robot
data) and commentary on key LfV challenges (e.g., missing information in video
and LfV distribution shifts). Our literature review begins with an analysis of
video foundation model techniques that can extract knowledge from large,
heterogeneous video datasets. Next, we review methods that specifically
leverage video data for robot learning. Here, we categorise work according to
which RL knowledge modality (KM) benefits from the use of video data. We
additionally highlight techniques for mitigating LfV challenges, including
reviewing action representations that address missing action labels in video.
  Finally, we examine LfV datasets and benchmarks, before concluding with a
discussion of challenges and opportunities in LfV. Here, we advocate for
scalable foundation model approaches that can leverage the full range of
internet video data, and that target the learning of the most promising RL KMs:
the policy and dynamics model. Overall, we hope this survey will serve as a
comprehensive reference for the emerging field of LfV, catalysing further
research in the area and facilitating progress towards the development of
general-purpose robots.
