Portfolio (6)

In-software Pandas/PySpark switching

Problem A legacy product for multiple regression had been implemented using Spark RDDs. The person who wrote the code had left. The code was becoming difficult to maintain or extend and wasteful for small datasets. Contribution refactored the code, allowing for a change of computational…

Continue reading...