from what i understand the way google work is thru content keywords so it shouldn't matter if your template is changed...
Maybe other people came up with more content rich stuff and pushed ur site ranking backwardS?