This varies depending on which state you are to be married in...not where you actually live. Not only is each state different but each courthouse has their own way of doing things as well. Your best bet is to contact the courthouse you plan to go to directly and ask them exactly what you need.
The basics: (Always double check with your actual courthouse!)
Pennsylvania
Legal Age:18
Blood Test: None
Fees: $50 cash only
ID: Valid Photo ID, Proof of SSI#
Both Bride and Groom must be present to apply
Where: May apply anywhere in the state
Waiting period: 72 hours (Some courts will post date so you can take it with you!)
Valid for: 60 days
If Previously Married: Divorce decree or death certificate required
New Jersey
Legal Age:18
Blood Test: None
Fees: $28 cash
ID: Valid Photo ID
Both Bride and Groom must be present to apply with witness
Where: Apply where the Bride lives, if not NJ, then where the Groom lives, if both are out of state then where the wedding will be held.
Waiting period: 72 hours
Valid for: 30 days
If Previously Married: Divorce decree or death certificate required
You will need to know the name and address of your officiant when you apply
Delaware
Legal Age:18
Blood Test: None
Fees: $30 cash only
ID: Valid Photo ID
Both Bride and Groom must be present to apply with witness
Waiting period: 24 hours for residents, 96 hours for non-residents
Valid for: 30 days
If Previously Married: Divorce decree or death certificate required
Maryland
Legal Age:18
Blood Test: None
Fees: $35 - $60.00 cash or credit cards. Varies by county. If you have completed a state recognized pre-marital preparation course, you may receive a discount on the license fee.
ID: Driver's License or birth certificate
Only one applicant needs to be present.
Where: In the county where you intend to be married
Waiting period: 48 hours
Valid for: 6 months
If Previously Married: Divorce decree or death certificate required
Most traditional churches only rent their churches to members and they perform the ceremonies. There are some who are willing to rent their churches.
Quaker churches: http://www.quakerfinder.org/
Unitarian churches: http://www.uua.org/CONG/index.php
Old Pine Street Presbyterian Church: 412 Pine Street (corner of Pine and 4th Streets) in Philadelphia, PA. (215) 925-8051
Wayside Chapel: 1151 Horsham Road in Ambler, PA. (215)542-9132
Allaire Chapel: Allaire State Park in Farmingdale, NJ. (732)919-3500