The upcoming Facility for Rare Isotope Beams (FRIB) at Michigan State University provides a new opportunity to access some of the world's most specialized scientific resources: radioisotopes. An excess of useful radioisotopes will be formed as FRIB fulfills its basic science mission of providing rare isotope beams. In order for the FRIB beams to reach high-purity, many of the isotopes are discarded and go unused. If harvested, the unused isotopes could enable new research for diverse applications ranging from medical therapy and diagnosis to nuclear security. Given that FRIB will have the capability to create about 80% of all possible atomic nuclei, harvesting at FRIB will provide a fast path for access to a vast array of isotopes of interest in basic and applied science investigations. To fully realize this opportunity, infrastructure investment is required to enable harvesting and purification of otherwise unused isotopes. An investment in isotope harvesting at FRIB will provide a powerful resource for development of crucial isotope applications. In 2010, the United States Department of Energy Office of Science, Nuclear Physics, sponsored the first 'Workshop on Isotope Harvesting at FRIB', convening researchers from diverse fields to discuss the scientific impact and technical feasibility of isotope harvesting. Following the initial meeting, a series of biennial workshops was organized. At the fourth workshop, at Michigan State University in 2016, the community elected to prepare a formal document to present their findings. This report is the output of the working group, drawing on contributions and discussions with a broad range of scientific experts.