Building permits are required for anything new being added to the exterior of your property. This would include the following: storage shed, fence, paving/cementing a gravel driveway, deck, patio, etc.
Building permits are required if you are replacing windows or doors that are larger than what was originally installed.
Building permits are NOT required for replacing siding or shingles, unless the size is changing (due to added structures or awnings).