Data Science Archives | Civis Analytics

Category Data Science

Fairness in Data Science

by Henry H.

Here at Civis, we build a lot of models. Most of the time we’re modeling people and their behavior because that’s what we’re particularly good at, but we’re hardly the only ones doing this — as we enter the age of “big data” more and more industries are applying machine learning techniques to drive person-level decision-making. This comes with exciting...

Read More 

More Data More Problems: Variable Selection with Multiple Response Variables

by Sam W.

More data isn’t always better! This post will go over why and how we removed uninformative variables from a modeling dataset using a custom-built neural network architecture along with cross-checks using more traditional supervised learning algorithms. The end result is a better curated dataset for our model-building process. The Problem This is kind of weird, right? All you hear about...

Read More 

CivisML: Scikit-Learn at Scale

CivisML: Scikit-Learn at Scale

by Stephen H.

Late last year, my colleagues on the Social Science team were working on a new survey weighting scheme that would greatly improve the precision of our public opinion data. To make it work, they needed to fit dozens of models for each completed survey. Each survey asks multiple questions, each of which would need to be modeled individually, using an...

Read More 

Putting the Power of Campaign Targeting in Your Hands: VoteWithMe

Putting the Power of Campaign Targeting in Your Hands: VoteWithMe

by David S.

A few weeks ago, I was canvassing in New Hampshire to knock on the doors of strangers and ask them to make a plan to vote. See – I’m a data scientist, and I don’t know what you know about data scientists, but we’re not the most extroverted creatures. That’s when I had the idea, “How much more effective would...

Read More 

Civis at PyData Chicago 2016

Civis at PyData Chicago 2016

by Michael H.

Data science is an interdisciplinary endeavor. It requires a variety of technical knowledge, from computer science to statistics to data visualization. While conferences are a great way to gain such knowledge, many conferences focus only on particular aspects of data science (e.g., NIPS for machine learning, or PyCon for Python programming), and so one would have to go to several...

Read More 

In first debate, Clinton – ‘Professional’, Trump – ‘Bully’

In first debate, Clinton – ‘Professional’, Trump – ‘Bully’

by Nick A.

Last Monday night, more Americans than ever before tuned in to watch the first presidential debate, and we at Civis did too. And while we were as interested in the back-and-forth between Clinton and Trump as anyone, we were most excited to see voters’ reactions in the following days. That’s when we turned to our social science team to field...

Read More