Data Sources - US

From TechWiki

Contents 1 US Data Sources 2 Census County Data 3 EIA County Data 3.1 Other sources in US

US Data Sources

• A census tract is a small statistical subdivision of a county. Census tract data allows a user to find population and housing statistics about a specific part of an urban area.
• http://www.census.gov/main/www/a2z/
• http://dataferrett.census.gov/
• http://www.thedataweb.org/datasets.html
• county data:
  • census tract data (SF4): http://www.census.gov/prod/cen2000/doc/sf4.pdf

State
   County
      County subdivision3
         Place (or place part)
            Census tract

• • ftp downloads: http://www2.census.gov/census_2000/datasets/Summary_File_4/
• means of disaggregating and combining geo areas
• TIGER/Line files: http://www.census.gov/geo/www/tiger/tgrshp2007/tgrshp2007.html Census Bureau's MAF/TIGER® (Master Address File / Topologically Integrated Geographic Encoding and Referencing) database
• Census tract boundary files (others, as well): http://www.census.gov/geo/www/cob/bdy_files.html
• http://freegeographytools.com/2007/thematic-polygon-shapefile-display-in-google-maps
• http://prod.library.utoronto.ca:8090/maplib/googlepolygons.html
• GADM database of Global Administrative Areas
• http://www.census.gov/geo/www/tractez.html

Census County Data

• County-level Census lookups ('Hot Report'): http://smpbff2.dsd.census.gov/TheDataWeb_HotReport/servlet/HotReportEngineServlet?reportid=95f6cba42876b4487e2a8078fdaf4ec6&emailname=whazard@census.gov&filename=ed_general_v2.hrml
  • http://www.census.gov/popest/topics/methodology/
  • USA counties: http://censtats.census.gov/usa/usa.shtml
  • USA Counties features over 6,500 data items for the United States, States and counties from a variety of sources. Files include data published for 2008 estimates and many items from the 2000 Census of Population and Housing, the 1990 census, the 1980 census and the 2002, 1997, 1992, 1987, 1982 and 1977 economic censuses.
  • Information in USA Counties is derived from the following general topics: age, agriculture, ancestry, banking, building permits, business patterns, crime, earnings, education, elections, employment, government, health, households, housing, income, labor force, manufactures, population, poverty, retail trade, social programs, veterans, vital statistics, water use, and wholesale trade.
  • Files contain a collection of data from the U. S. Census Bureau and other Federal agencies, such as the Bureau of Economic Analysis, the Bureau of Labor Statistics, the Federal Bureau of Investigation, and the Social Security Administration.

 AFN - Accommodation and Food Services - NAICS only
 AGE - Age
 AGN - Agriculture - NAICS
 AGS - Agriculture - SIC
 ANC - Ancestry
 BNK - Banking
 BPS - Building Permits
 BZA - Business, Private Nonfarm - (U.S. Census Bureau) - Total
 BZN - Business, Private Nonfarm - (U.S. Census Bureau) - NAICS
 BZS - Business, Private Nonfarm - (U.S. Census Bureau) - SIC
 CLF - Civilian Labor Force (Bureau of Labor Statistics)
 CRM - Crime
 EAN - Earnings, Total and Selected Industries (Bureau of Economic Analysis) - NAICS
 EAS - Earnings, Total and Selected Industries (Bureau of Economic Analysis) - SIC
 EDU - Education
 ELE - Elections (CQ Press)
 EMN - Employment (Bureau of Economic Analysis) - NAICS
 EMS - Employment (Bureau of Economic Analysis) - SIC
 FED - Federal Government
 GAN - Government (Bureau of Economic Analysis) - Earnings - NAICS
 GEE - Government (Bureau of Economic Analysis) - Earnings/Employment - SIC
 GEN - Government (Bureau of Economic Analysis) - Employment - NAICS
 HEA - Health
 HIS - Hispanic or Latino Population
 HSD - Households
 HSG - Housing
 INC - Income, Money (U.S. Census Bureau)
 IPE - Income and Poverty
 LFE - Labor Force (U.S. Census Bureau)
 LND - Land Area
 LOG - Local Area Government
 MAN - Manufactures - NAICS
 MAS - Manufactures - SIC
 NES - Nonemployer Statistics
 PEN - Personal Income (Bureau of Economic Analysis) - NAICS
 PIN - Personal Income (Bureau of Economic Analysis) - SIC
 POP - Population - Total and Selected Characteristics
 PPQ - Population - Group Quarters
 PST - Population Estimates
 PVY - Poverty
 RHI - Race data
 RTN - Retail Trade - NAICS
 RTS - Retail Trade - SIC
 SBO - Survey of Business Owners
 SEX - Sex data
 SPR - Social Programs - Social Security and Supplemental Security Income (SSI)
 VET - Veterans
 VST - Vital Statistics - Births, Deaths, and Infant Deaths
 WAT - Water Usage
 WTN - Wholesale Trade - NAICS

• Actual downloadable files (Excel): http://www.census.gov/support/DataDownload.htm
• Download stats: http://www.census.gov/support/USACdata.html
• Data source notes: http://www.census.gov/support/%5C%5Cpsb.acsd.census.gov/ACSDReview/ccdb/internet/appa.pdf
• State, county US data sources: http://www.fedstats.gov/regional.html

EIA County Data

• Not much apparently directly available
• See http://www.eia.doe.gov/emeu/reps/contents.html
• http://www.eia.doe.gov/emeu/reps/enduse/er_doc.html
• http://www.eia.doe.gov/emeu/recs/contents.html
• http://www.eia.doe.gov/emeu/reps/links.html
• MAISY proprietary databases (incl county): http://www.maisy.com/energy.htm

Other sources in US

• http://www.strikeiron.com/Catalog/ProductDetail.aspx?pv=2.0.0&pn=US+Census+Information
  • ($1200 to $2400 annually)
• http://www.analygis.com/Products/google_api.htm
• http://belay.extendthereach.com/api/packages/
• http://gecensus.stanford.edu/gcensus/index.html (free, but still only SF1)
• Amazon is now hosting all United States TIGER Census data in its cloud.
• http://en.wikipedia.org/wiki/Topologically_Integrated_Geographic_Encoding_and_Referencing
• http://developer.amazonwebservices.com/connect/kbcategory.jspa?categoryID=248 (TIGER and Census data hosted as free EBS):
• http://developmentseed.org/blog/2009/may/19/hosting-tiger-us-census-data-amazons-cloud
• http://www.openstreetmap.org/
• http://wiki.openstreetmap.org/wiki/Planet.osm
• http://wiki.openstreetmap.org/wiki/TIGER
• TownMe: http://blog.townme.com/2009/10/townme-geoapi-allows-new-types-of.html
• http://code.google.com/p/geo-api/wiki/Demos
• http://www.geocommons.com/
• http://www.thisweknow.org/about - competitor to Citizen DAN
• http://www.rdfabout.com/demo/census/ (Tauberer in RDF form)
• GRASS GIS (http://grass.osgeo.org/index.php)
• Open Source Geospatial Foundation (http://www.osgeo.org/)
• http://wiki.osgeo.org/wiki/Geodata_Repository
• http://www.stat.columbia.edu/~cook/movabletype/archives/2008/03/crime_data_bona.html
  • crime data for 17 K police departments; 150 MB (http://sociology.osu.edu/mdm/UCR1960-2004.zip)
• http://www.datawrangling.com/some-datasets-available-on-the-web
• http://delicious.com/pskomoroch/dataset (460 datasets)
• very interesting paid service that returns Census Tracts, etc. : http://www.dyngeometry.com/web/XYQuery.aspx (about $0.10 each after initial free ones)
• http://freegeographytools.com/ is a goldmine of useful information and links
• Bruce Ralston has just released a new tool called AFF Mapper that goes a step beyond his previous ones: it can convert TIGER shapefile data into KML format, link it to tabular American Fact Finder data (AFF) from the US Census, and plot this census data thematically. But unlike the previous TIGER tools, this one is a general-purpose one; it can convert any shapefile – point, line or polygon – into a thematic or unique value KML file, with the option of using thematic data from a linked external table. The only limitation is that the shapefile must be in geographic coordinates (lat/long), WGS84 datum, Google Earth’s native coordinate system.

I won’t go through the process with Census data; there’s an excellent PDF manual that

• http://tnatlas.geog.utk.edu/tea/downloadfree.htm
• http://www.entabular.com/ (tools and commercially sold gov data)