MPK
MPK
About Me
Posts
Projects
Light
Dark
Automatic
python
CoDA: Coding Agents on Databricks Apps
A Databricks App that hosts five coding agents (Claude Code, Codex, Gemini CLI, Hermes, OpenCode) in your tenancy.
Marshall Krassenstein
GitHub
Fast Cache Duck and Dash - How to Build an in Memory Cache for your Python Apps with DuckDB on Databricks
Learn how to implement lightning-fast caching in your Python Dash applications using DuckDB and Databricks SQL. This comprehensive guide covers various caching strategies, their pros and cons, and a real-world example that transforms slow queries into instant responses. Perfect for data engineers and developers looking to enhance user experience and reduce costs.
Marshall Krassenstein
Sep 13, 2025
11 min read
Conformal Inference for Regression Models
Put a prediction interval around any model you want with conformal inference! I walk through conformal inference techniques for regression problems, including absolute and locally weighted conformal inference, with model logging and deployment using MLFlow on Databricks.
Marshall Krassenstein
Sep 12, 2025
15 min read
How to make any Unity Catalog Table into a Lakebase Table
Some simple helper functions that create and update Lakebase Tables from Unity Catalog Tables.
Marshall Krassenstein
Jul 9, 2025
10 min read
Streamlining Databricks Catalog Permission Management
An article I wrote for the Databricks medium blog that shows how to view and set permissions for Unity Catalog tables
Marshall Krassenstein
Jun 25, 2025
0 min read
Retention involves a lot of luck
Some basic probabilistic experiments to help understand if retention is a good way to evaluate employee performance.
Marshall Krassenstein
Dec 2, 2024
11 min read
How to make chatGPT argue with itself
Reliably simulate an argument in a relationship about using ChatGPT to resolve disputes
Marshall Krassenstein
Nov 9, 2024
19 min read
Better automation infrastructure for 911 call forecasting
Using Docker and AWS Lambdas to schedule calls to the Detroit 911 API
Marshall Krassenstein
Oct 2, 2024
14 min read
Analyze any file you want with an api call
An article I wrote for the DataRobot blog that shows how to run RAG on the fly (links externally)
Marshall Krassenstein
Nov 22, 2023
0 min read
Answer all of your RFPs really fast with the RFP Monster
An app I built to automate answering RFPs with Langchain and FAISS
Marshall Krassenstein
»
Cite
×