My optimization problem gradually becomes infeasible in a loop

I guess this is because computer has a limited precision. As your iteration goes on, the algorithm starts to converge, the requirements on precision become higher and higher, then something unexpected can happend.