  This paper surveys a range of methods to collect necessary performance data
on Intel CPUs and NVIDIA GPUs for hierarchical Roofline analysis. As of
mid-2020, two vendor performance tools, Intel Advisor and NVIDIA Nsight
Compute, have integrated Roofline analysis into their supported feature set.
This paper fills the gap for when these tools are not available, or when users
would like a more customized workflow for certain analysis. Specifically, we
will discuss how to use Intel Advisor, RRZE LIKWID, Intel SDE and Intel
Amplifier on Intel architectures, and nvprof, Nsight Compute metrics, and
Nsight Compute section files on NVIDIA architectures. These tools will be used
to collect information for as many memory/cache levels in the memory hierarchy
as possible in order to provide insights into application's data reuse and
cache locality characteristics.
