In the PSD (hermitian) case, you have described a standard reformulation trick used many times on this forum, sometimes with the aid of cyclic permutation invariance of trace.
In the non-PSD (hermitian) case, I think even in the alternating optimization scheme, the objective is non-convex. Can you prove otherwise?