The iron arsenide CaFe(4)As(3) features a three-dimensional network derived from intergrown Fe(2)As(2) layers and Ca ions in channels. Complex magnetic interactions between Fe atoms give rise to unexpected transitions and novel direction-dependent magnetic behavior.