Perovskite oxynitrides, in addition to being promising electrocatalysts and photoabsorbers, present an interesting case study in crystal symmetry. Full or partial ordering of the O and N anions affects global symmetry and influences material performance and functionality; however, anion ordering is challenging to detect experimentally. In this work, we synthesize a novel perovskite oxynitride CaW(O,N)3 and characterize its crystal structure using both X-ray and neutron diffraction. Through co-refinement of the diffraction patterns with a range of literature and theory-derived model structures, we demonstrate that CaW(O,N)3 adopts an orthorhombic Pnma average structure and exhibits octahedral distortion with evidence for preferred anion site occupancy. However, through comparison with a large, low-symmetry unit cell, we identify the presence of disorder that is not fully accounted for by the high-symmetry model. We compare CaW(O,N)3 with SrW(O,N)3 to demonstrate the broader presence of such disorder and identify contrasting features in the electronic structures. This work signifies an updated perspective on the inherent crystal symmetry present in perovskite oxynitrides.