Stat Mills

Let’s say you have a trend you are trying to model that you know to be monotonically increasing or decreasing; this could be something like default as a function of risk, power usage as a function of temperature, or CO2 emissions over time. Generalized Additive Models (GAMs) are a great... [Read More]

I recently found out that the Federal Housing Authority publishes a ton of granular housing data and wanted to start exploring the data for Atlanta, where I live. I’m not sure there will be anything revelatory in here, but sometimes it’s fun to look at a map. FHA Public Use... [Read More]

Sometimes in my Data Science projects I need a quick and easy way to measure and visualize a predictive trend for several independent variables. My go to way to do this is to use Weight of Evidence and Information Value. Recently I put together some code in python to calculate... [Read More]

In my last post I covered how you can fit Penalized Splines using the glum library in Python. Notionally glum was built to fit Generalized Linear Models. However it was designed to give the user the option to pass in a custom penalty matrix. We took advantage of this capability... [Read More]

I recently discovered a new python library for fitting GLMs called glum. This package is developed not only to be fast but also allows custom penalties for different terms in the model, as well as including your own penalty matrix in your model fitting. This could allow us to include... [Read More]