Developer Resources

Software developers and researchers can use these resources to help people find useful government information.

1.USA.gov Data 

About

1.USA.gov URLs are created whenever anyone shortens a .gov or .mil URL using bitly. Learn more about 1.USA.gov URLs on the USA.gov Blog.

The data

We provide a raw pub/sub feed of data created any time anyone clicks on a 1.USA.gov URL. The pub/sub endpoint responds to http requests for any 1.USA.gov URL and returns a stream of JSON entries, one per line, that represent real-time clicks.

You can access the feed at http://developer.usa.gov/1usagov

We store hourly archives of the raw data. You can also explore the raw data on Data.gov.

The JSON data dictionary is as follows:

    
    {
        "a": USER_AGENT, 
        "c": COUNTRY_CODE, # 2-character iso code
        "nk": KNOWN_USER,  # 1 or 0. 0=this is the first time we've seen this browser
        "g": GLOBAL_BITLY_HASH, 
        "h": ENCODING_USER_BITLY_HASH,
        "l": ENCODING_USER_LOGIN,
        "hh": SHORT_URL_CNAME,
        "r": REFERRING_URL,
        "u": LONG_URL,
        "t": TIMESTAMP,
        "gr": GEO_REGION,
        "ll": [LATITUDE, LONGITUDE],
        "cy": GEO_CITY_NAME,
        "tz": TIMEZONE # in http://en.wikipedia.org/wiki/Zoneinfo format
        "hc": TIMESTAMP OF TIME HASH WAS CREATED, 
        "al": ACCEPT_LANGUAGE http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html#sec14.4 
    }

Code from the 1.USA.gov Hack Day

We held a nationwide 1.USA.gov Hack Day on July 29, 2011 to encourage people to explore the 1.USA.gov data. The following code was created by participants and shared publicly for others to use:

Projects from the 1.USA.gov Hack Day

A number of items were created in anticipation of and at the Hack Day. Most tools centered around finding popular links, showing links by location, and using click data to enhance security:

  • Popular now - Barg Upender and Adam created a site called PopGov.us that shows which government links are popular in real time.
  • Popularity by day - Measured Voice created GovClicks to show the most popular links per day. GovClicks is built using Gogogon which consumes the 1.USA.Gov click feed and generates daily rankings of URLs.
  • NASA links - Adam Laiacano analyzed 1.USA.gov data and found that 42% of all clicks on 1.USA.gov links go to NASA websites. He created a map that shows that people in Europe are more likely to only click on NASA links, while people in the United States click on links from a wider variety of government links.
  • Across the world - Helmut Hissen made an animation that shows clicks across the globe on 1.USA.gov links from June 2 through July 14. Red flashes represent clicks from non-mobile devices, and green flashes represent clicks from mobile devices. Note that the final NASA Shuttle launch occurred on July 8. There’s a dramatic increase in activity at the 1:24 mark.
  • Map of clicks - Chris Metcalf built a tool that ingests the 1.USA.gov data and feeds it into Data.gov. It also feeds the data into a Google Map to show clicks based on location.
  • Popularity by location - Robert built a tool that searches for the most popular links near your city or within your country.
  • NASA shuttle launch - Bitly created a visualization that shows clicks around the globe that relate to the NASA shuttle launch on July 8.
  • Sharing by domain - Shreyas Karnik looked at which government domains are commonly shortened at a particular point of time and from what location. The resulted in a map showing the location of where the top 10 domains are shared.
  • DNSSEC status - Earl Crane, Scott Rose, and Richard Bullington-McGuire worked on a tool to look at the popularity of 1.USA.gov links against the DNSSEC status of .gov domains. Their project is still in progress, but the code is available to the public (gogogon fork and DNSSEC List Walk).
  • DNSSEC status visualization - Duane Wessels graphed the DNSSEC status of domains by popularity of short URLs from that domain. The size of nodes in the graph represent the number of URLs at or below that name that were shortened. A number of agencies have DNSSEC deployed on their own domains, but employ third party CDN services, such as Akamai, which do not utilize DNSSEC at this point. Scripts and additional results are also available.
  • Twitter mentions - Dmitry Kachaev compared the list of .gov domain names from Data.gov against 1.USA.gov data. He found that only 296 registered domains, out of 1,731, were mentioned on Twitter in the past 60 days. He also created Python code to get archived click data.
  • Creation and clicks - Harlan Harris looked at the time difference between when a link was created and when it was clicked. He created density plots to show the results. Results are available on his blog.
  • Word cloud - Hani Anani used 1.USA.gov data to identify popular government links, and then analyzed the contents with Open Calais to create a word cloud that summarizes popular government topics in near real time.
  • Sonifications - Niki Yoshiuchi from the New York event created a sonification, or audio representation of the data. Joachim Gossmann is also started working on a variety of sonifications.

Product Recall API 

About

The Product Recall Data API returns data on product safety and recalls from three federal government agencies:

  • Food safety data from the Centers for Disease Control and Prevention;
  • Car safety data from the National Highway Traffic Safety Administration; and,
  • Product safety data from the Consumer Product Safety Commission.

You can see how this data is used when searching for recalls.

View the full documentation for the Product Recall API.


FAQ XML 

About

The contents of our frequently asked questions are available in XML, in English and Spanish.

You can see how the XML feed is used at answers.usa.gov.

The XML