Overview

• Andre Mesarovic - Big data, Spark, Databricks, MLflow, MLOps, model serving
• LinkedIn
• github
  • github.com/amesar
  • github.com/mlflow/mlflow-export-import - Migrate MLflow objects - magnum opus

Slide Presentations

• MLflow Object Relationships - 14 slides - PDF - slideshare - 2022-11-23
• MLflow Model Serving - Data + AI Summit 2021 (DAIS) - 51 slides - PDF slides - slideshare - 2021-05-27
• ONNX and MLflow - Spark Meetup - 40 slides - 2020-02-26
• MLflow and MLeap - 29 slides - 2019-12-03
• Spark Summit (SAIS) - 2019 - Managing the Complete Machine Learning Lifecycle with MLflow - Tutorial
  • Spark Summit video - Youtube
  • https://github.com/amesar/mlflow-spark-summit-2019 - code examples
• Pragmatic REST APIs - All things REST - 73 slides - 2013-05-07

github

github.com/mlflow

• github.com/mlflow/mlflow-export-import - Migrate MLflow objects (runs, experiments or registered models) from one tracking server (Databricks workspace) to another. Magnum opus.

github.com/amesar

MLflow

• mlflow-examples - MLflow examples - basic and advanced.
• mlflow-tools - Some useful tools for MLflow.
• mlflow-resources - MLflow FAQ.
• mlflow-tensorflow-serving - Creates a TensorFlow Serving Docker container with an embedded MLflow Keras TensorFlow model.
• mlflow-model-monitoring - POC for MLflow model server that logs requests and responses for predictions.
• mlflow-pluggable-scoring-server - POC for extensible scoring server that allows you to plug in custom request or response payloads handlers.
• mleap-sampler - Exhaustive MLeap examples in both Scala and Python.
• mlflow-spark-summit-2019 - MLflow content for Spark Summit 2019 tutorial.

MLflow Social

• https://github.com/mlflow/mlflow/issues?q=amesar

MLflow Java Client

• Implemented the first pass for MLflow Java client in 2018.
• github.com/amesar/mlflow - Fork.
• github.com/amesar/mlflow/tree/java-client-protobuf/mlflow-java - README.
• github.com/amesar/mlflow/mlflow-java/src/main/java/com/databricks/mlflow/client - Code.

Databricks

• databricks-api-workflow - Python wrapper around the Databricks REST API to execute job runs in a synchronous polling manner.
• databricks-api-sdk - Databricks API SDK Choices.
• databricks-cluster-recreate - How do I recreate my suddenly departed Databricks clusters?
• databricks-tests - Run pytest integration tests on Databricks with a wheel using the "run submit" API endpoint.

Spark

• docker-spark-hive-metastore - Launch docker containers with Spark and Hive sharing a common Hive MySQL metastore.
• hive-spark-ddl-converter - POC that converts Hive DDL to Spark DDL (limited).

Hive JSON

• hive-json
• hive-json-schema-gen
• hive-serde-json

Themes

• Docker work
  • mlflow-tensorflow-serving - Build TensorFlow Serving docker container from Python code.
  • mlflow-examples/docker/docker-server - Docker compose for running MLflow tracking server.
  • docker-spark-hive-metastore - Docker compose for Spark and Hive containers.

Other

• hl7-json-spark

Resource Links

• Feature Store Resources
• Model Monitoring Drift Resources