No, this is not the case. Germany will not consider you stateless.
In certain circumstances, Germany will tolerate dual citizenship upon nationalization.
Some countries don't allow a renunciation at all.
Some countries make it very difficult.
For 2nd, 3rd generation Turks, court rulings have allowed such exceptions (Military service deemed unreasonable): ...