Blog

Thoughts and innovations in open government and civic technology.


Towards a less harmful data practice: The DataMade way


Towards a less harmful data practice: The DataMade way

Nov 03, 2022 by Fatima Gomez

Data can be a powerful tool for illuminating our world, but it can also reproduce bias, perpetuate harm, and subvert truth. A significant amount of our work at DataMade involves making data available, accessible, and intelligible; we therefore must take steps to minimize the biases, harm, and fallacies that can come from utilizing data irresponsibly.

Read more »


Join the DataMade team! (Applications closed)


Join the DataMade team! (Applications closed)

Aug 15, 2022 by Derek Eder , Forest Gregg , Hannah Cushman Garland

Do you want to build mission-driven technology? Do you want to engineer fresh ideas about civic tech? Do you want to extract meaningful insights from data? We’re looking for a full-time developer to start in September or October 2022. This position will be fully remote. Apply here!

Read more »


Join the DataMade team! (Applications closed)


Join the DataMade team! (Applications closed)

Nov 10, 2021 by Derek Eder , Forest Gregg , Hannah Cushman Garland

Do you want to build mission-driven technology? Do you want to engineer fresh ideas about civic tech? Do you want to extract meaningful insights from data? We’re looking for a full-time developer to start in December 2021 or January 2022. This position will be fully remote. Apply here!

Read more »


Working against systems of oppression


Working against systems of oppression

Jul 21, 2021 by Hannah Cushman Garland , Derek Eder , Forest Gregg

Last summer, DataMade made a commitment to examine the ways in which our work has supported systems that destroy Black lives, particularly policing and incarceration. As we wrote then, this is slow work, and much of it is quiet work rooted in reflection, study, and relationship building. A year later, we’d like to share an update on the steps we have taken so far and reaffirm our commitment to continue working to redirect power from oppressive systems to those that support democracy, justice, and equity for all.

Read more »


Hannah Cushman Garland is now a Partner at DataMade


Hannah Cushman Garland is now a Partner at DataMade

May 10, 2021 by Derek Eder , Hannah Cushman Garland , Forest Gregg

Today we’re happy to announce that Hannah Cushman Garland has joined Derek Eder and Forest Gregg as a Partner and co-owner of DataMade. Hannah joined the DataMade team as a Developer in 2016. An alumna of the Missouri School of Journalism and a veteran of the Associated Press, she remains deeply interested in people, systems, and power. She brings a healthy skepticism to technology, believing that it can alleviate specific pain points but is rarely a solution in and of itself.

Read more »


Why We


Why We're Switching from AWS to Heroku

Aug 17, 2020 by Jean Cochrane , Hannah Cushman Garland

After five years of maintaining a custom deployment framework on Amazon Web Services, the DataMade team is switching to deploying containerized Django apps on Heroku. Here’s why and how we decided to switch.

Read more »


Accounting for our part in supporting systems of oppression


Accounting for our part in supporting systems of oppression

Jul 13, 2020 by Forest Gregg , Derek Eder

In this time of grief and uprising, we have been examining the ways that we, as a company, have supported systems that destroy Black lives, and what we can do to meet this moment of possibility. It is slow work and much of it should be quiet work. Over the past ten years, we have come to know that policing in America is not compatible with a healthy, equitable democracy; that policing in America destroys precious Black lives like George Floyd, Ahmaud Arbery, Breonna Taylor, Rekia Boyd, Quintonio LeGrier, Bettie Jones, Harith Augustus, and Laquan McDonald.

Read more »


DataMade’s response to COVID-19


DataMade’s response to COVID-19

Mar 19, 2020 by Derek Eder , Forest Gregg

In response to the COVID-19 outbreak, the DataMade team is now 100% remote and practicing social distancing. We plan on maintaining this setup for the duration of the outbreak and will keep our office operating at full capacity. Here are a few resources for transitioning to remote teams and resources and actions to slow the spread of COVID-19.

Read more »


Introducing Civic Exchange Chicago


Introducing Civic Exchange Chicago

Sep 17, 2019 by Derek Eder

Today, I am proud to announce the founding of a new civic venture! Civic Exchange Chicago is a coworking space and learning community centered on how news, information and technology can increase democracy and freedom. Since February 2019, we have been gleefully sharing an office and incubating our shared vision with seven other civic and journalism organizations: Block Club Chicago, BrightHive, The Center for Tech and Civic Life, Chalkbeat Chicago, Change Illinois, Hearken and mRelief.

Read more »


Mapping Twenty Years Of CPS Closures During The DataMade Mentorship


Mapping Twenty Years Of CPS Closures During The DataMade Mentorship

May 08, 2019 by Jay Yugen

Jay Yugen worked with twenty years of Chicago Public School data to begin creating choropleth maps illustrating public school closures, in the context of their demographics and that of their surrounding neighborhoods.

Read more »


How to put crontabs under version control


How to put crontabs under version control

Mar 27, 2019 by Regina Compton

DataMaders keep loads of things under version control – including a seemingly elusive part of scheduling infrastructure: crontabs. This post explains how we version crontabs and why.

Read more »


Building Live Healthy, West Side During the DataMade Mentorship


Building Live Healthy, West Side During the DataMade Mentorship

Feb 26, 2019 by Karen Aguirre

During the mentorship program Karen Aguirre created LiveHealthyWestSide.com, a website that showcases the work of West Side United and the health indices of 10 Chicago communities.

Read more »


Apply for the inaugural DataMade Mentorship Program


Apply for the inaugural DataMade Mentorship Program

Oct 09, 2018 by Forest Gregg , Bea Malsky , Jasmine Mithani

The DataMade mentorship is a six-week, one-on-one mentorship program for beginning technologists and the technologically curious working to develop a specific skill or address a specific problem. We’re accepting applications for the first cohort through October 25, 2018!

Read more »


Transactional Testing with Pytest and Flask-SQLAlchemy


Transactional Testing with Pytest and Flask-SQLAlchemy

Jul 18, 2018 by Jean Cochrane

In this blog post we’ll cover DataMade’s approach to testing highly-stateful web apps like Dedupe.io, and introduce a new open-source plugin that we’re releasing to make it easier to test stateful Flask-SQLAlchemy apps using pytest: pytest-flask-sqlalchemy-transactions.

Read more »


Introducing the Chicago Data Collaborative


Introducing the Chicago Data Collaborative

Jan 23, 2018 by Forest Gregg , Jean Cochrane

DataMade is thrilled to take part in the launch of the Chicago Data Collaborative, a cooperative effort by civil society organizations to share capacity with the goal of strengthening local criminal justice reporting and advocacy in Chicago and Cook County.

Read more »


Modern Approaches to Schema Matching


Modern Approaches to Schema Matching

Dec 12, 2017 by Forest Gregg , Peter Xu

In this memo, we review the literature on schema matching—a set of principled approaches to automatically detecting what kinds of data are contained in databases of enormous size and uncertain format.

Read more »


Machine Assisted Dossiers


Machine Assisted Dossiers

Nov 14, 2017 by Forest Gregg , Jean Cochrane , Tim McGovern

Existing research tools make it difficult for teams to pursue investigations when source material is uncertain or contradictory. This whitepaper outlines the requirements for a knowledge system that can manage ambiguity during investigations and produce useful, structured data as a byproduct.

Read more »


WhoWasInCommand makes it harder for human rights abusers to hide


WhoWasInCommand makes it harder for human rights abusers to hide

Nov 06, 2017 by Jean Cochrane

This week we’re thrilled to launch WhoWasInCommand, a fully auditable dossier for tracking security force activity around the globe that we built for the Security Force Monitor.

Read more »


Councilmatic arrives in Los Angeles


Councilmatic arrives in Los Angeles

May 17, 2017 by Regina Compton

DataMade launches a new version of Councilmatic for the Los Angeles County Metropolitan Transportation Authority to help the public keep track of their Board of Directors, meetings, and reports.

Read more »


Scrutinizing City Council


Scrutinizing City Council

Mar 09, 2017 by Regina Compton

DataMade launches an email subscription service on Councilmatic.

Read more »


Get the lead (and the word) out with City Bureau


Get the lead (and the word) out with City Bureau

Jan 09, 2017 by Hannah Cushman

We extracted lead test results from hundreds of PDFs so you don’t have to. You saw them in a special issue of South Side Weekly guest edited by City Bureau. Now, the data is yours to explore.

Read more »


Securing Municipal IDs


Securing Municipal IDs

Jan 04, 2017 by Forest Gregg

This whitepaper describes technical measures that can be used to protect data about immigrants in a municipal ID program.

Read more »


Ain’t No Party Like a README Party


Ain’t No Party Like a README Party

Jan 02, 2017 by Regina Compton

This holiday season, we read and revised several of our most popular READMEs – making the open-source world a happier, more festive place to be.

Read more »


Brand new tools for analyzing community-level data


Brand new tools for analyzing community-level data

Nov 21, 2016 by Jean Cochrane

This week, DataMade is excited to announce three new additions to our open-source toolkit for developers. We’ve added libraries for dealing with data on crime, schools, and demographics in Illinois and across the United States.

Read more »


Following the money in New Mexico politics just got a whole lot easier


Following the money in New Mexico politics just got a whole lot easier

Oct 10, 2016 by Derek Eder

We’re happy to announce the launch of The Openness Project with our partners New Mexico In Depth. Based on campaign finance reports collected by the New Mexico Secretary of State, The Openness Project lets you search and browse all political contributions, expenditures, and candidates in statewide and local New Mexico races.

Read more »


We find your reps so you don’t have to


We find your reps so you don’t have to

Jul 26, 2016 by Derek Eder

My Reps is a tool for looking up your elected representatives across the United States. Based on your address, we can find all the federal, state, county, and local officials who represent you in government. We built it to be completely open source, easy to repurpose, and easy to customize by political organizations.

Read more »


Introducing Dedupe.io


Introducing Dedupe.io

Apr 28, 2016 by Derek Eder

Today, DataMade is launching something new. It’s not a map, or an app. It’s a product called dedupe.io. And it will transform your messy data into something much more useful.

Read more »


DataMade at NICAR 2016


DataMade at NICAR 2016

Mar 10, 2016 by Derek Eder

This week, DataMade will be in Denver for NICAR 2016, a yearly conference hosted by Investigative Reporters and Editors (IRE) on data journalism. We’ll be presenting on the work we’ve been doing and sharing our open source tools for working with, cleaning up and visualizing data. News nerds, look for us in Denver! We’d love to talk to you!

Read more »


Civic Tech Done Right – Community Driven, Community Responsive, Community Friendly


Civic Tech Done Right – Community Driven, Community Responsive, Community Friendly

Feb 08, 2016 by Derek Eder , Taryn Roch , Andrea Ortez

Neighborhood organizers and software developers don’t ordinarily move in the same circles. But in Chicago, thanks to some tool-hungry community organizers and neighborhood-oriented software developers, a couple of computer applications have emerged that are enabling neighborhood residents to play a greater role in improving their communities. This is a story, told from the perspective of three people, of how and why those applications were developed.

Read more »


Demystifying Chicago politics with Councilmatic


Demystifying Chicago politics with Councilmatic

Jan 25, 2016 by Derek Eder

Thanks to the support of the Sunlight Foundation, I am proud to announce that DataMade is launching a brand-new version Chicago Councilmatic. Track all things related to Chicago City Council.

Read more »


Introducing: Illinois Sunshine


Introducing: Illinois Sunshine

Aug 07, 2015 by Derek Eder , Sarah Brune (ICPR)

We teamed up with the Illinois Campaign for Political Reform to build Illinois Sunshine, a tool for browsing candidates, political committees, donations to campaigns and expenditures by campaigns in Illinois going back to 1994. Campaign finance data in Illinois has never been more accessible.

Read more »


Better Living Through Documentation


Better Living Through Documentation

May 28, 2015 by Cathy Deng

Effective technical communication shouldn’t be an afterthought; it’s crucial to open source development. Here are 20 practical tips.

Read more »


Parse names and parse ... anything, really


Parse names and parse ... anything, really

Mar 03, 2015 by Jeff Ernsthausen (AJC) , Cathy Deng

Based on the success of usaddress, The Atlanta Journal-Constitution and DataMade are happy to announce two new parser tools in our collaboration: probablepeople - a parser for person names and parserator - a toolkit for making your own probabilistic, domain-specific parser.

Read more »


Parsing addresses with usaddress


Parsing addresses with usaddress

Oct 10, 2014 by Cathy Deng , Jeff Ernsthausen (AJC)

Last week, the Atlanta Journal Constitution (AJC) announced the first public product from our collaboration - usaddress, a python library for parsing US addresses using advanced natural language processing (NLP) methods.

Read more »


DataMade at the Code for America Summit


DataMade at the Code for America Summit

Oct 02, 2014 by Derek Eder

The Code for America Summit, a yearly open government and civic tech conference, was held in San Francisco last week. DataMade was able to share two of our client’s stories to this international community of government leaders, funders, policy experts, and technologists.

Read more »


What are civic apps for?


What are civic apps for?

Sep 11, 2014 by Forest Gregg

One of the wonderful things about civic technology is that no one really knows what it means. ‘Civic technology’ covers varying types of projects made by a variety of people trying to do very different things. This fuzziness is useful. It challenges civic technologists to think independently about what exactly they are trying to do, while providing a wide set of projects and models to steal from or define themselves against. All the same, we can begin to identify four major intentions of civic apps.

Read more »


Show Me the Election Money!


Show Me the Election Money!

Jul 29, 2014 by Derek Eder

DataMade and the Illinois Campaign for Political Reform (ICPR) are launching a new app today called Election Money. It provies bulk downloads of campaign finance data from the Illinois State Board of Elections.

Read more »


Large Lots 2.0


Large Lots 2.0

Jul 01, 2014 by Derek Eder

LargeLots.org is back, this time in East Garfield Park! If you own land in this west side Chicago neighborhood, you can buy up two vacant lots from the City of Chicago for $1 each.

Read more »


The Launch of LargeLots.org


The Launch of LargeLots.org

Apr 04, 2014 by Derek Eder

The City of Chicago is selling empty lots to South Side residents for $1 until April 21st, 2014 as part of their neighborhood stabilization initiative. To lower the barrier to apply for one of these ~4,000 lots and increase the number of potential applicants, we made an app to help residents find eligible lots and navigate this process - largelots.org.

Read more »


Introducing Spreadsheet Deduper


Introducing Spreadsheet Deduper

Mar 17, 2014 by Derek Eder

DataMade is launching a free online tool for de-duplicating spreadsheets.

Read more »


Dedupe 0.5


Dedupe 0.5

Mar 17, 2014 by Forest Gregg

Today, we are excited to announce a major update to the dedupe library! The new features include parallel processing support, improved record linkage across files, and a new asynchronous architecture.

Read more »


The Power of Open Data


The Power of Open Data

Jan 14, 2014 by Derek Eder

In November, we got an e-mail from Triway International Group asking DataMade to share our open data work and what’s been going on with the Chicago Open Government community with 17 delegates from the National Bureau of Statistics of the People’s Republic of China.

Read more »


Making a Living with Civic Tech


Making a Living with Civic Tech

Oct 16, 2013 by Derek Eder

For the open government movement to sustain itself and continue to grow, we need to build businesses off of projects that emerge from our civic technology community.

Read more »