I have a wonderful reaction of marble chips, $\ce{CaCO3}$, with hydrochloric acid, $\ce{HCl}$, and carbon dioxide was released beautifully (fast, large volume, easy to measure and makes good visual effect too). But there is no reaction between $\ce{CaCO3}$ and $\ce{H2SO4}$. Why not?
Your marble chips react on the surface.

In the case of hydrochloric acid, the resulting salt, calcium chloride, is highly soluble in the acid, dissolves and provides further attack to the (new) surface.

With sulfuric acid, the highly insoluble calcium sulfate is formed on the surface of the marble chip. With other words:

Calcium sulfate acts like a protective layer.
