Have You disabled the amp? just ensure to check all amp url is redirected to the correct url already to avoid 404.