While content pages and categories let you set a custom header via the control panel, it's a little trickier for the cart/checkout pages.
To do this, you need to make new header/footer files and name them appropriately. The software will then utilise these new templates automatically.
|Cart Page (with products in cart)||shopping_cart.template.html|
|Cart Page (with an empty cart)||empty_cart.template.html|