Bad programmers speak in absolutes (just like Sith). They also Good programmers use the clearest solution possible (all other things being equal).
Using break and continue frequently makes code hard to follow. But if replacing them makes the code even harder to follow, then that's a bad change.
The example you gave is definitely a situation where the breaks and continues should be replaced with something more elegant.