May I know which search engine rankings fell off the radar?
If it is the rankings of the old URLs, then it might be because 301 redirection would pass your link juice from the old to the new pages. It might also be good to see your new page's rankings.
It might take a little time for the passing of link juice from old to new and thus is the reason for the change in rankings.