This folio package was a two-page spread in the paper focusing on poor prospects for recent grads. It wouldn’t translate well online: not only would the text appear in a linear way, but you’d lose the scanability from the blurbs. I built this interactive using gRaphael… for some reason. Really, it would have been easier to create static images since the interactivity was low. But it was good practice and an exercise in turning around an interactive very quickly. See the full version.

I’m honoured to have one of my interactives nominated for the first annual Data Journalism Awards. The international competition is supported by Google and run by the Global Editors Network. It’s also the first of its kind in the world. The Globe submitted a handful of pieces and the Sunshine List interactive was nominated for international/national data application. The sortable, searchable table took a couple weeks of scraping, refining and developing to get in working order. I also found a way to search the previous year’s records to show any change in income or benefits, adding an interesting layer to the data. There are some fantastic entires from The Guardian, The Australian, the BBC, The Toronto Star and more. See all the nominees.

This interactive lets you explore mucho data behind Vancouver’s high schools, from capacity to graduation rates. It was created using Raphael, a Javascript library that creates vector images, so it’s great for maps. I also used gRaphael to create an animate some pie charts and bar charts. My favourite part, though, came from mapping the location of all the students. It took a lot of work — resizing the dots, scaling and positioning them to match the native data. But the final result is pretty cool. See the full interactive.

I’ve started a new collective, kind of like the Open House Arts Collective of yore, but this time about data journalism. It’s called Ad Hoc Data. It’s a chance to work with like-minded nerds interested in exploring the tech and story-telling that comes from data. Our first project, a federal budget calculator, took quite a bit of time and offered some interesting results. Try it yourself. I’m excited to see where it goes next. It’s a chance for me to experiment and create with more freedom than usually afforded to me. And a chance to meet other like-minded folks interested in creating, creating and creating.

The Ontario government released their annual Sunshine List on March 24, detailing public sector employees earning more than $100,000 per year. I created a table so readers can explore the list in more detail, letting you can search, sort and filter by name, salary and more. This list is published each year on the Government’s website in a way that’s hard to search, impossible to sort and difficult to navigate. The Globe wanted to pull the data from this year’s list and publish it in a more usable way, as a tool for our reporters and our readers. Here’s a little background on how I made the tool. I started by building a scraper, a program that trolls web pages for content and saves it in a more sophisticated way than copy-paste. Using a coding language called Python, I built a universal scraper that could pull all the data back [...]

This map takes data from the Toronto Traffic Safety Unit and plots over 2,000 points measuring traffic volume. I’ve also added a unique view showing just the top 100, where the radius of each circle corresponds to the number of cars passing through that point. Finally, we used on qualitative data to plot the ten most congested points in the city. Each uses a different technique: the first uses standard Fusion Tables plotting; the second uses a custom Fusion Tables query and several calculations to plot circle objects onto the map; the third makes another query and uses the latitude and longitude as coordinates to plot custom icons. Overall this took about a week and accompanies a great story on traffic congestion.

My latest map plots the various hazards that threaten the Northern Gateway pipeline — from underground earthquakes to landslides to protected animal populations. The pipeline ends at Kitimat, B.C., a small coastal port on the west Coast. From there, oil’s transferred onto tankers and tugged through the maze of the Douglas Channel. There are three exit opens but only one approved anchor point. It’s an interesting look at the tremendous difficulty in getting oil out of Canada. View the full interactive

After scraping the content for all the Drummond reports, I wanted to show them in a simple way. Inspired by What The F#*! Should I Make For Dinner, I created this simple site that shows a random recommendation with option to tweet the ones you like. The site works by pulling in all the recommendations in a JSON file, then creating a random number and pulling that record. I also added a query option, so if you add “?37″ to the end, it’ll pull the 37th recommendation. This is helpful for tweeting and recalling an interesting recommendation. Visit the site.

The Drummond Report offered mucho insight into Ontario’s future. But the recommendations themselves were buried in 300 pages of background and chitter. What if you just wanted the recommendations? You could browse all 20 chapters on the government website. Or, with some deft scraping, you could pull them down and throw them into a table of your own. That’s what I did last week with the help of ScraperWiki, a super-handy website that gets you up-and-running with Python, Mechanize and other scraping libraries in no time flat. Download the Drummond report recommendations (CSV) or visit the website for the full text. How the scrape worked Here’s a look at the full scrape from ScraperWiki. You can see this on the site too.

Google has a lovely suite of tools for creating custom maps, chief among them the Maps API and Fusion Tables. They work together like brother and sister to create respectable visualizations with mucho data. Let’s dive in. Get your data ready Your data should be in a clean CVS or XLS table. You’ll probably have to do some work refining things first. (Hey, check out Google Refine for that!) Then spend some time doing simple graphs and interviewing the data in Excel for trends and clues. When you have an idea of what you want to map, open up Fusion Tables. For the purposes of this tutorial, let’s use my spreadsheet on B.C. federal prisons, available on BuzzData. Uploading to Fusion Tables Go to Fusion Tables (click “see my tables” from the splash screen). But DO NOT try to just upload the file to Google Docs. Instead, go to Create > [...]