A 17-year-old boy and a 19-year-old man have been arrested over an arson attack on a synagogue, police said.