I've never done it but I would make sure to use fire bricks. Chances are this won't happen but if regular briks from Home Depot get hot enough, they can explode. Again, I've never seen it but it's a concern, especially if you're going to have kids around.