Skip to main content
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
kipkc09
New Contributor

How to log/register ML model with MLFlow, with the model items in specified folder in workspace

Hi,

I'm trying to use MLFlow in Fabric notebook. I have logged the trained model using: mlflow.sklearn.log_model(model1, artifact_path="model_path", signature=signature). I have found that model1 appears as a Fabric model item in the root directory of my workspace, which is making the workspace very untidy, when I train multiple models for different projects.
- How does MLflow in Fabric notebook usethe artifact_path parameter provided?
- I found a 'model_path' folder under the associated Experiment item. What are the files that get stored there?
- Is it possible to set where the model item for model1 gets saved to a user-specified folder within the Fabric workspace?

Thanks for your help!

1 ACCEPTED SOLUTION
v-pnaroju-msft
Honored Contributor II

Thankyou, @nilendraFabric, for your response.

Hi kipkc09,

We appreciate your inquiry through the Microsoft Fabric Community Forum.

In addition to the response provided by @nilendraFabric , and to facilitate better workspace organization across projects, please find below some approaches that may help resolve the issue:

  1. Prefix model names with project identifiers during registration.

    mlflow.register_model(model_uri, "ProjectA_Model_v1")

  2. Use MLflow tags to organize and filter models.

    mlflow.set_tags({
    "project": "ProjectA",
    "team": "Analytics",
    "version": "v1.0"
    })

  3. Create and log runs to separate experiments per project.

    mlflow.set_experiment("/ProjectA/ML_Experiments")

If you find our response helpful, kindly mark it as the accepted solution and provide kudos. This will assist other community members facing similar queries.

Thank you.




View solution in original post

3 REPLIES 3
nilendraFabric
Honored Contributor

MLflow utilizes the provided artifact_path to determine the subfolder inside the runโ€™s artifact location where it will store all files related to the model. This means that even though the model files are grouped in โ€œmodel_pathโ€ for that run, the overall registration of the model in Fabricโ€™s model registry will still occur in the default area of the workspac

Relative paths are not supported  and the MLflow UI does not currently allow specifying a custom folder location for separate model registration

v-pnaroju-msft
Honored Contributor II

Thankyou, @nilendraFabric, for your response.

Hi kipkc09,

We appreciate your inquiry through the Microsoft Fabric Community Forum.

In addition to the response provided by @nilendraFabric , and to facilitate better workspace organization across projects, please find below some approaches that may help resolve the issue:

  1. Prefix model names with project identifiers during registration.

    mlflow.register_model(model_uri, "ProjectA_Model_v1")

  2. Use MLflow tags to organize and filter models.

    mlflow.set_tags({
    "project": "ProjectA",
    "team": "Analytics",
    "version": "v1.0"
    })

  3. Create and log runs to separate experiments per project.

    mlflow.set_experiment("/ProjectA/ML_Experiments")

If you find our response helpful, kindly mark it as the accepted solution and provide kudos. This will assist other community members facing similar queries.

Thank you.




All of my MLFlow experiments show in the root directory of the Workspace in Fabric.  How do I set the path location to be a subfolder in the Fabric workspace?

Helpful resources

Announcements
Top Kudoed Authors
Users online (11,584)