Blog

Join the DataMade team! (Application closed)

Jul 09, 2024 by Derek Eder , Forest Gregg , Hannah Cushman Garland

Do you want to build mission-driven technology? Do you want to engineer fresh ideas about civic tech? Do you want to extract meaningful insights from data? We’re looking for a full-time, Chicago-based developer to start in August or September 2024. This position will be fully remote. Apply here!

Towards a less harmful data practice: The DataMade way

Nov 03, 2022 by Fatima Gomez

Data can be a powerful tool for illuminating our world, but it can also reproduce bias, perpetuate harm, and subvert truth. A significant amount of our work at DataMade involves making data available, accessible, and intelligible; we therefore must take steps to minimize the biases, harm, and fallacies that can come from utilizing data irresponsibly.

Join the DataMade team! (Application closed)

Aug 15, 2022 by Derek Eder , Forest Gregg , Hannah Cushman Garland

Do you want to build mission-driven technology? Do you want to engineer fresh ideas about civic tech? Do you want to extract meaningful insights from data? We’re looking for a full-time developer to start in September or October 2022. This position will be fully remote. Apply here!

Join the DataMade team! (Applications closed)

Nov 10, 2021 by Derek Eder , Forest Gregg , Hannah Cushman Garland

Do you want to build mission-driven technology? Do you want to engineer fresh ideas about civic tech? Do you want to extract meaningful insights from data? We’re looking for a full-time developer to start in December 2021 or January 2022. This position will be fully remote. Apply here!

Working against systems of oppression

Jul 21, 2021 by Hannah Cushman Garland , Derek Eder , Forest Gregg

Last summer, DataMade made a commitment to examine the ways in which our work has supported systems that destroy Black lives, particularly policing and incarceration. As we wrote then, this is slow work, and much of it is quiet work rooted in reflection, study, and relationship building. A year later, we’d like to share an update on the steps we have taken so far and reaffirm our commitment to continue working to redirect power from oppressive systems to those that support democracy, justice, and equity for all.

Hannah Cushman Garland is now a Partner at DataMade

May 10, 2021 by Derek Eder , Hannah Cushman Garland , Forest Gregg

Today we’re happy to announce that Hannah Cushman Garland has joined Derek Eder and Forest Gregg as a Partner and co-owner of DataMade. Hannah joined the DataMade team as a Developer in 2016. An alumna of the Missouri School of Journalism and a veteran of the Associated Press, she remains deeply interested in people, systems, and power. She brings a healthy skepticism to technology, believing that it can alleviate specific pain points but is rarely a solution in and of itself.

Why We're Switching from AWS to Heroku

Aug 17, 2020 by Jean Cochrane , Hannah Cushman Garland

After five years of maintaining a custom deployment framework on Amazon Web Services, the DataMade team is switching to deploying containerized Django apps on Heroku. Here’s why and how we decided to switch.

Accounting for our part in supporting systems of oppression

Jul 13, 2020 by Forest Gregg , Derek Eder

In this time of grief and uprising, we have been examining the ways that we, as a company, have supported systems that destroy Black lives, and what we can do to meet this moment of possibility. It is slow work and much of it should be quiet work. Over the past ten years, we have come to know that policing in America is not compatible with a healthy, equitable democracy; that policing in America destroys precious Black lives like George Floyd, Ahmaud Arbery, Breonna Taylor, Rekia Boyd, Quintonio LeGrier, Bettie Jones, Harith Augustus, and Laquan McDonald.

DataMade’s response to COVID-19

Mar 19, 2020 by Derek Eder , Forest Gregg

In response to the COVID-19 outbreak, the DataMade team is now 100% remote and practicing social distancing. We plan on maintaining this setup for the duration of the outbreak and will keep our office operating at full capacity. Here are a few resources for transitioning to remote teams and resources and actions to slow the spread of COVID-19.

Introducing Civic Exchange Chicago

Sep 17, 2019 by Derek Eder

Today, I am proud to announce the founding of a new civic venture! Civic Exchange Chicago is a coworking space and learning community centered on how news, information and technology can increase democracy and freedom. Since February 2019, we have been gleefully sharing an office and incubating our shared vision with seven other civic and journalism organizations: Block Club Chicago, BrightHive, The Center for Tech and Civic Life, Chalkbeat Chicago, Change Illinois, Hearken and mRelief.

Mapping Twenty Years Of CPS Closures During The DataMade Mentorship

May 08, 2019 by Jay Yugen

Jay Yugen worked with twenty years of Chicago Public School data to begin creating choropleth maps illustrating public school closures, in the context of their demographics and that of their surrounding neighborhoods.

How to put crontabs under version control

Mar 27, 2019 by Regina Compton

DataMaders keep loads of things under version control – including a seemingly elusive part of scheduling infrastructure: crontabs. This post explains how we version crontabs and why.

Building Live Healthy, West Side During the DataMade Mentorship

Feb 26, 2019 by Karen Aguirre

During the mentorship program Karen Aguirre created LiveHealthyWestSide.com, a website that showcases the work of West Side United and the health indices of 10 Chicago communities.

Apply for the inaugural DataMade Mentorship Program

Oct 09, 2018 by Forest Gregg , Bea Malsky , Jasmine Mithani

The DataMade mentorship is a six-week, one-on-one mentorship program for beginning technologists and the technologically curious working to develop a specific skill or address a specific problem. We’re accepting applications for the first cohort through October 25, 2018!

Transactional Testing with Pytest and Flask-SQLAlchemy

Jul 18, 2018 by Jean Cochrane

In this blog post we’ll cover DataMade’s approach to testing highly-stateful web apps like Dedupe.io, and introduce a new open-source plugin that we’re releasing to make it easier to test stateful Flask-SQLAlchemy apps using pytest: pytest-flask-sqlalchemy-transactions.

Introducing the Chicago Data Collaborative

Jan 23, 2018 by Forest Gregg , Jean Cochrane

DataMade is thrilled to take part in the launch of the Chicago Data Collaborative, a cooperative effort by civil society organizations to share capacity with the goal of strengthening local criminal justice reporting and advocacy in Chicago and Cook County.

Modern Approaches to Schema Matching

Dec 12, 2017 by Forest Gregg , Peter Xu

In this memo, we review the literature on schema matching—a set of principled approaches to automatically detecting what kinds of data are contained in databases of enormous size and uncertain format.

Machine Assisted Dossiers

Nov 14, 2017 by Forest Gregg , Jean Cochrane , Tim McGovern

Existing research tools make it difficult for teams to pursue investigations when source material is uncertain or contradictory. This whitepaper outlines the requirements for a knowledge system that can manage ambiguity during investigations and produce useful, structured data as a byproduct.

WhoWasInCommand makes it harder for human rights abusers to hide

Nov 06, 2017 by Jean Cochrane

This week we’re thrilled to launch WhoWasInCommand, a fully auditable dossier for tracking security force activity around the globe that we built for the Security Force Monitor.

Councilmatic arrives in Los Angeles

May 17, 2017 by Regina Compton

DataMade launches a new version of Councilmatic for the Los Angeles County Metropolitan Transportation Authority to help the public keep track of their Board of Directors, meetings, and reports.

Scrutinizing City Council

Mar 09, 2017 by Regina Compton

DataMade launches an email subscription service on Councilmatic.

Get the lead (and the word) out with City Bureau

Jan 09, 2017 by Hannah Cushman

We extracted lead test results from hundreds of PDFs so you don’t have to. You saw them in a special issue of South Side Weekly guest edited by City Bureau. Now, the data is yours to explore.

Securing Municipal IDs

Jan 04, 2017 by Forest Gregg

This whitepaper describes technical measures that can be used to protect data about immigrants in a municipal ID program.

Ain’t No Party Like a README Party

Jan 02, 2017 by Regina Compton

This holiday season, we read and revised several of our most popular READMEs – making the open-source world a happier, more festive place to be.

Brand new tools for analyzing community-level data

Nov 21, 2016 by Jean Cochrane

This week, DataMade is excited to announce three new additions to our open-source toolkit for developers. We’ve added libraries for dealing with data on crime, schools, and demographics in Illinois and across the United States.

Following the money in New Mexico politics just got a whole lot easier

Oct 10, 2016 by Derek Eder

We’re happy to announce the launch of The Openness Project with our partners New Mexico In Depth. Based on campaign finance reports collected by the New Mexico Secretary of State, The Openness Project lets you search and browse all political contributions, expenditures, and candidates in statewide and local New Mexico races.

We find your reps so you don’t have to

Jul 26, 2016 by Derek Eder

My Reps is a tool for looking up your elected representatives across the United States. Based on your address, we can find all the federal, state, county, and local officials who represent you in government. We built it to be completely open source, easy to repurpose, and easy to customize by political organizations.

Introducing Dedupe.io

Apr 28, 2016 by Derek Eder

Today, DataMade is launching something new. It’s not a map, or an app. It’s a product called dedupe.io. And it will transform your messy data into something much more useful.

DataMade at NICAR 2016

Mar 10, 2016 by Derek Eder

This week, DataMade will be in Denver for NICAR 2016, a yearly conference hosted by Investigative Reporters and Editors (IRE) on data journalism. We’ll be presenting on the work we’ve been doing and sharing our open source tools for working with, cleaning up and visualizing data. News nerds, look for us in Denver! We’d love to talk to you!

Civic Tech Done Right – Community Driven, Community Responsive, Community Friendly

Feb 08, 2016 by Derek Eder , Taryn Roch , Andrea Ortez

Neighborhood organizers and software developers don’t ordinarily move in the same circles. But in Chicago, thanks to some tool-hungry community organizers and neighborhood-oriented software developers, a couple of computer applications have emerged that are enabling neighborhood residents to play a greater role in improving their communities. This is a story, told from the perspective of three people, of how and why those applications were developed.

Demystifying Chicago politics with Councilmatic

Jan 25, 2016 by Derek Eder

Thanks to the support of the Sunlight Foundation, I am proud to announce that DataMade is launching a brand-new version Chicago Councilmatic. Track all things related to Chicago City Council.

Introducing: Illinois Sunshine

Aug 07, 2015 by Derek Eder , Sarah Brune (ICPR)

We teamed up with the Illinois Campaign for Political Reform to build Illinois Sunshine, a tool for browsing candidates, political committees, donations to campaigns and expenditures by campaigns in Illinois going back to 1994. Campaign finance data in Illinois has never been more accessible.

Better Living Through Documentation

May 28, 2015 by Cathy Deng

Effective technical communication shouldn’t be an afterthought; it’s crucial to open source development. Here are 20 practical tips.

Parse names and parse ... anything, really

Mar 03, 2015 by Jeff Ernsthausen (AJC) , Cathy Deng

Based on the success of usaddress, The Atlanta Journal-Constitution and DataMade are happy to announce two new parser tools in our collaboration: probablepeople - a parser for person names and parserator - a toolkit for making your own probabilistic, domain-specific parser.

Parsing addresses with usaddress

Oct 10, 2014 by Cathy Deng , Jeff Ernsthausen (AJC)

Last week, the Atlanta Journal Constitution (AJC) announced the first public product from our collaboration - usaddress, a python library for parsing US addresses using advanced natural language processing (NLP) methods.

DataMade at the Code for America Summit

Oct 02, 2014 by Derek Eder

The Code for America Summit, a yearly open government and civic tech conference, was held in San Francisco last week. DataMade was able to share two of our client’s stories to this international community of government leaders, funders, policy experts, and technologists.

What are civic apps for?

Sep 11, 2014 by Forest Gregg

One of the wonderful things about civic technology is that no one really knows what it means. ‘Civic technology’ covers varying types of projects made by a variety of people trying to do very different things. This fuzziness is useful. It challenges civic technologists to think independently about what exactly they are trying to do, while providing a wide set of projects and models to steal from or define themselves against. All the same, we can begin to identify four major intentions of civic apps.

Show Me the Election Money!

Jul 29, 2014 by Derek Eder

DataMade and the Illinois Campaign for Political Reform (ICPR) are launching a new app today called Election Money. It provies bulk downloads of campaign finance data from the Illinois State Board of Elections.

Large Lots 2.0

Jul 01, 2014 by Derek Eder

LargeLots.org is back, this time in East Garfield Park! If you own land in this west side Chicago neighborhood, you can buy up two vacant lots from the City of Chicago for $1 each.

The Launch of LargeLots.org

Apr 04, 2014 by Derek Eder

The City of Chicago is selling empty lots to South Side residents for $1 until April 21st, 2014 as part of their neighborhood stabilization initiative. To lower the barrier to apply for one of these ~4,000 lots and increase the number of potential applicants, we made an app to help residents find eligible lots and navigate this process - largelots.org.

Introducing Spreadsheet Deduper

Mar 17, 2014 by Derek Eder

DataMade is launching a free online tool for de-duplicating spreadsheets.

Dedupe 0.5

Mar 17, 2014 by Forest Gregg

Today, we are excited to announce a major update to the dedupe library! The new features include parallel processing support, improved record linkage across files, and a new asynchronous architecture.

The Power of Open Data

Jan 14, 2014 by Derek Eder

In November, we got an e-mail from Triway International Group asking DataMade to share our open data work and what’s been going on with the Chicago Open Government community with 17 delegates from the National Bureau of Statistics of the People’s Republic of China.

Making a Living with Civic Tech

Oct 16, 2013 by Derek Eder

For the open government movement to sustain itself and continue to grow, we need to build businesses off of projects that emerge from our civic technology community.