Vacuum Insulation Panels (VIPs) are so-called super insulation materials characterized by a very low thermal conductivity (λ) in the range of 0.002–0.008 W/(m K). VIPs consist of an evacuated core material encapsulated by a high-barrier film designed to minimize the permeation of air and moisture into the panel. In terms of low λ, core materials should minimize thermal transport due to solid conduction and radiation. Additionally, a low sensitivity against unavoidable pressure increase (p1/2) requires small pore sizes. Common core materials are fumed silica and glass fibres. Fumed silica provides the best trade-off between low λ in the evacuated state and high robustness against pressure increase but also carries a high amount of embodied energy, which counteracts the advantage of the efficient material input. In fact, 95–99% of the embodied energy related to the production of fumed silica-based VIPs is related to the core material. In that sense, using renewable raw materials for VIP cores shows a high potential to reduce the environmental impact. This paper shows investigations of different wood fibre assortments for the production of VIP core materials (WoodVIP). As a result, the influence of particle size distributions and the mat-forming process on both λ and p1/2 is visible. By optimizing the particle size distribution and conformation of fibres in the mat, values of λ of 3.2 mW/(m K) and p1/2 of 4 mbar can be reached on core materials with a low bulk density of 150 kg/m3. Investigations also show that outgassing of native extractives are mutually not problematic, even though the use of wood species with a low amount of native extractives seems recommendable. Concerning its sustainability, the WoodVIP showed a significant reduction in 10 of 13 environmental impact categories by 25–90% compared to a conventional fumed silica-based VIP.