Open Source Archives | Civis Analytics

Tag Open Source

Hacktoberfest At Civis

by Elizabeth S.

Many of the best tools for data science workflows are open source and community-maintained. Tools such as scikit-learn, pandas, and numpy in Python, as well as dplyr and ggplot2 in R, are basic building blocks for almost all data scientists in industry and academia today. At Civis, not only do we rely on these tools to build our data science...

Read More 

CivisML: Scikit-Learn at Scale

CivisML: Scikit-Learn at Scale

by Stephen H.

Late last year, my colleagues on the Social Science team were working on a new survey weighting scheme that would greatly improve the precision of our public opinion data. To make it work, they needed to fit dozens of models for each completed survey. Each survey asks multiple questions, each of which would need to be modeled individually, using an...

Read More 

Interpreting and Visualizing Neural Networks for Text Processing

Interpreting and Visualizing Neural Networks for Text Processing

by Michael H.

This post was written by Melissa Roemmele. It highlights a project she worked on during her internship with the Data Science R&D department in Summer 2016. Introduction Neural networks have become the go-to approach for text processing tasks, but they are also notorious for their obscurity. Recently, we applied a neural network to the task of predicting numerical ratings for...

Read More 

GephiForceDiagramTool: Automatically create attractive network visualizations

GephiForceDiagramTool: Automatically create attractive network visualizations

by Adrianna J.

One aspect of the people-centered data science that we do at Civis is social network analysis. Connections between people in the online or physical world can give us insight into how a population can be segmented or how information spreads in a community. As we look to get the most extensive understanding of these network connections, we have turned to...

Read More 

glmnet for Python

glmnet for Python

by Bill L.

I’ve learned many things since I joined Civis. Least expected though is a new appreciation for simple linear regression and classification models. Shortly after I started, I was asked to evaluate a collection of modeling pipelines on a sample of typical prediction problems at Civis. Glancing at the list, I distinctly remember thinking the real task here was to measure...

Read More 

Open Source at Civis Analytics

Open Source at Civis Analytics

by Civis Analytics

Here at Civis Analytics, we love open source. We use Ruby on Rails, AngularJS, Docker, and Go (to name a few projects), and we’re happy to contribute back to the community and release our own open source projects. We’re pleased to announce our new open source page where we will publish our open source projects and list our policies. We...

Read More 

RubyAudit: Tirelessly auditing Ruby and RubyGems so you don’t have to

RubyAudit: Tirelessly auditing Ruby and RubyGems so you don’t have to

by Jeff C.

Security is hard. You’re busy writing code, but you also want to keep your application secure, so you’re doing double-duty developing new features and keeping an eye on vulnerabilities. You follow Hacker News and Reddit, but you know any good security strategy revolves around defense in depth, and you’re looking to add additional, automated tiers to help keep an eye...

Read More 

If it loses its quack, does it still talk like a duck? Using Swagger to detect breaking API changes.

If it loses its quack, does it still talk like a duck? Using Swagger to detect breaking API changes.

by Jeff C.

A while back we decided that all new functionality in the Civis platform would be implemented as a combination of API endpoints and front-end code. At the same time, we decided that all endpoints will be available to our customers. That is, if you can use a piece of functionality via the Civis UI, you can leverage the underlying API...

Read More