{"author":"XetHub","author_email":"contact@xethub.com","bugtrack_url":null,"classifiers":["Development Status :: 3 - Alpha","Operating System :: MacOS","Operating System :: POSIX :: Linux","Programming Language :: Python","Programming Language :: Python :: 3","Programming Language :: Python :: 3 :: Only","Programming Language :: Python :: 3.10","Programming Language :: Python :: 3.11","Programming Language :: Python :: 3.7","Programming Language :: Python :: 3.8","Programming Language :: Python :: 3.9","Programming Language :: Python :: Implementation :: CPython","Programming Language :: Python :: Implementation :: PyPy"],"description":"# MLflow-XetHub\nThis plugin integrates XetHub with MLflow so that you can use existing MLflow code to track experiments but store artifacts to XetHub.\n\n## Install plugin\nInstall from PyPI for the plugin's published version\n`pip install mlflow[xethub]`\n\nOr clone this repo and install locally for the latest code \n```bash\ngit clone https://github.com/xetdata/MLflow-XetHub.git\ncd MLflow-XetHub\npip install .\n```\n\n## Authenticate with XetHub \nIf you haven't already, [create an XetHub account](https://xethub.com/assets/docs/getting-started/installation#create-a-xethub-account).\n\nThe plugin uses [PyXet](https://github.com/xetdata/pyxet) to access XetHub, so you need to authenticate with XetHub in one of the following two ways.\n### Option 1: [Log in with Xet CLI](https://xethub.com/assets/docs/getting-started/installation#configure-authentication)\n```\nxet login --email --user --password \n```\n\n### Option 2: [Export xet credentials as environment variables](https://pyxet.readthedocs.io/en/latest/#environment-variable)\n\n```bash\nexport XET_USER_EMAIL = \nexport XET_USER_NAME = \nexport XET_USER_TOKEN = \n```\n### \n\n## Create a XetHub repo to store your artifacts\nGo to https://xethub.com/ and [create a new repo](https://xethub.com/assets/docs/workflows/clone-and-iterate#create-a-xet-repository) to store your MLflow artifacts.\n\nOr [log in with Xet CLI](log-in-with-xet-cLI) and `xet repo make xet:/// --private / --public`\n\n## Run your MLflow as is \n### Run MLflow server specifying XetHub repo to store artifact\nNo need to modify your MLflow code. The plugin will automatically detect MLflow runs and artifacts and store them in your XetHub repo once you start the MLflow server with:\n\n```bash\nmlflow server --backend-store-uri ./mlruns --artifacts-destination xet://// --default-artifact-root xet:////\n```\n\nwhich uses the `mlruns` directory on your machine as file store backend and XetHub as [artifact store](https://mlflow.org/docs/latest/tracking.html#artifact-stores) backend.\n\n### Run MLflow experiment\n*Experiments are logged in the directory where MLflow server is started, and the plugin and MLflow need to be running in the same python environment. \nSo make sure to run your MLflow code and server in the same directory as well as having the plugin and MLflow installed under the same environment.*\n\nUsing [MLflow's quickstart](https://docs.databricks.com/en/_extras/notebooks/source/mlflow/mlflow-quick-start-python.html) as an example,\n```python\nimport mlflow \nimport os\nimport numpy as np\nfrom mlflow import log_artifacts\nfrom sklearn.model_selection import train_test_split \nfrom sklearn.datasets import load_diabetes\nfrom sklearn.ensemble import RandomForestRegressor \n\nwith mlflow.start_run():\n mlflow.autolog() \n db = load_diabetes() \n\n X_train, X_test, y_train, y_test = train_test_split(db.data, db.target) \n\n # Create and train models. \n rf = RandomForestRegressor(n_estimators=100, max_depth=6, max_features=3) \n rf.fit(X_train, y_train) \n\n # Use the model to make predictions on the test dataset. \n predictions = rf.predict(X_test)\n\n if not os.path.exists(\"outputs\"):\n os.makedirs(\"outputs\")\n\n with open(\"outputs/pred.txt\", \"w\") as f:\n f.write(np.array2string(predictions))\n\n log_artifacts(\"outputs\")\n```\n\n### Store artifacts on XetHub and visualize in MLflow UI\nThe artifacts will be automatically stored on XetHub under the specified repo and branch. \n $\"artifact_on_xethub\"$ \n\nAnd the MLflow server will show the artifacts with UI on the default `http://127.0.0.1:5000` or your own host.\n $\"artifact_on_mlflow_ui\"$ \n","description_content_type":"text/markdown","docs_url":null,"download_url":"","downloads":{"last_day":-1,"last_month":-1,"last_week":-1},"dynamic":null,"home_page":"https://github.com/xetdata/Xet-MLflow","keywords":"ai,collaboration,data-science,developer-tools,git,mlflow,machine-learning,reproducibility","license":"BSD-3-Clause","license_expression":null,"license_files":null,"maintainer":"Kelton Zhang","maintainer_email":"kelton@xethub.com","name":"mlflow-xethub","package_url":"https://pypi.org/project/mlflow-xethub/","platform":null,"project_url":"https://pypi.org/project/mlflow-xethub/","project_urls":{"Homepage":"https://github.com/xetdata/Xet-MLflow"},"provides_extra":null,"release_url":"https://pypi.org/project/mlflow-xethub/0.0.0/","requires_dist":["mlflow >=1.27.0","pyxet >=0.1.0"],"requires_python":">=3.7","summary":"mlflow[xethub] is a mlflow plugin integrating XetHub with MLflow so that you can use existing MLflow code to track experiments but store artifacts to XetHub.","version":"0.0.0","yanked":false,"yanked_reason":null}

Dependencies of mlflow-xethub (2).
Dependency	Optional
mlflow	false
pyxet	false

Package search

mlflow-xethub

project_urls

Dependencies

All package metadata

Releases