Shadow Treasurer Jim Chalmers has ridiculed the Prime Minister's assumption that the economy would recover quickly.