Thanks @Michal_Adamaszek . I was fixated on the norm going the “correct” direction to be used in a convex fashion, and neglected to pay attention to the other term, which, as you point out, is not.
Therefore, the constraints are non-convex, and the problem is non-convex.