Sean Ma, PhD
This website records all the problems I encountered and the correct solutions I found, in Programming (mainly Python), DevOps, Data Analysis and Visualization, as well as Energy Markets:
- maki: Notes and tips from programming to energy markets and optimization.
- mspu: Python utils that either bring convenience or provide excellent performance.
- blogs: Selected topics demonstrating how to solve problems.
Who am I?
- Energy market modeller
- Software developer
- Data analyst
- Database maintainer
- DevOps practitioner
- ML learner
- Most importantly, a problem solver
My github links
My publications
My research was mainly on plasma diagnostics. A list of my publications is available here.
My blogs
-
Using Excel UDF to compare data differences
-
A quick note on TLS certificates
-
Polars null operations
-
Polars LazyFrame properties are expensive operations
-
Improve VarianceThreshold performance in ML feature selection
-
Reduce a python app run time from two hours to 20 seconds
-
Using Gurobi Python matrix API to reduce problem creation time
-
Which orchestration tool is better: Airflow, Prefect, Argo Workflows, or Temporal?
-
Make python loops 5x to 10x faster using numba
-
The pandas function pd.read_sql returns an empty DataFrame without correct data types
-
Read CSV files 10x to 40x faster using pyarrow and polars
-
Explode date ranges in a pandas DataFrame 30x faster
-
How to create dummy pandas DataFrames for testing
-
How to install and setup WSL on Windows
-
How to fix a corrupted Excel file with high CPU usage
-
Random notes on optimization