A vast amount of data is now available through the World-Wide Web. Here are a few pointers.
Crime data
Government and Economics
epidata
Earthquakes, Fires, and Climate
Historical
Sports
ASA Data Expo