Vertically aligned radial-junction solar cell designs offer potential improvements over planar geometries, as carrier generation occurs close to the junction for all absorption depths, but most production methods still require a single crystal substrate. Here, we report on the fabrication of such solar cells from polycrystalline, low purity (99.98%) p-type silicon starting material, formed into silicon core, silica sheath fibres using bulk glass draw techniques. Short segments were cut from the fibres, and the silica was etched from one side, which exposed the core and formed a conical cavity around it. We then used vapour deposition techniques to create p-i-n junction solar cells. Prototype cells formed from single fibres have shown conversion efficiencies up to 3.6%, despite the low purity of the starting material. This fabrication method has the potential to reduce the energy cost and the silicon volume required for solar cell production. Simulations were performed to investigate the potential of the conical cavity around the silicon core for light collection. Absorption of over 90% of the incident light was predicted, over a wide range of wavelengths, using these structures in combination with a 10% volume fraction of silicon.