DAT - Big Data (Lesson)

Data Never Sleeps

Big Data Analysis

So what can we do with the Big Data that is growing as fast as everyone enters it into cell phones and computers? Can analysis be done? The answer is that large amounts of data can be analyzed with computer programs and information extrapolated from them.    

Census Data

Below is the new United States Open Data Census 2015 detailing the most populous states.

The United States and other countries are making data available to the public in various files to use for analysis. The above census display is for the 13 most populous states in the country. These states indicate differences between them in analyzing the color bars in this mapping. Letter grades were assigned for the openness of data with 5 point signifying A - F at 0. Green is good, red is not. Though the chart is hard to read and the colors not described here, further detail into the analysis shows rating of the A - F.

This is a general listing of some of the states included in the 13 top populous states. The ratings here are in the A to F category. Clicking on a category provides more detail behind behind the questions that were asked to grade the category. Here are the questions on the Companies for Georgia.

Clicking on the data for the B- box for Georgia Companies, the 12 questions representing the 12 bars in the categories on the first image for that category appear.

This is a good exercise in looking at what massive data can do, the detail that can be used, and the complexity of the data. The method of display is still being reviewed, but a few comments have been made including the use of the colors on the charts. Red - green color blindness would make the charts unreadable by some people, an item that goes against open data for everyone.  

What is important concerning all results is collaboration. Through collaboration and sharing another person realized the issue with color-blindness and another the complexity of the heat mapping with the little bars. Just as big data is being opened, the use of data for the ease of understanding, the collaboration that allows understanding, must continue.

IMAGE FROM THE PUBLIC DOMAIN AND USED ACCORDING TO TERMS OF USE.