Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
4019Charan
New Contributor

Unable to pass Workspace and Dataflow IDs to dataflow activity.

Hello EveryOne @Everyone , So I'm trying to use one big orchestration pipeline to trigger different sub pipelines and dataflows according to the parameters provided. So based on the dataflow ID that I provide it should trigger the respective dataflow. But everytime I trigger my pipeline the dataflow fails. I don't understand what's wrong. When I manually hardcord the associated dataflow with the pipeline then it works, but when I try to call the dataflow using the provided variables it fails. Also the dataflow itself runs fine, i checked it by triggering it manually and it worked fine. If some one could help me solve the issue. It'd be really helpful. 

4019Charan_0-1748277017171.png

4019Charan_1-1748277095341.png

4019Charan_2-1748277138476.png

 

 

1 ACCEPTED SOLUTION
jennratten
Valued Contributor III

Hello @4019Charan  - I tested triggering dataflows Gen2 with and without CICD using dynamic content filled by parameters and variables.  The dataflow Gen2 with CICD failed with both parameters and variables while the dataflow Gen2 without CICD was successful with both parameters and variables.  Are you using dataflow gen2 with CICD?  If so, can you try it with out CICD?  I have included a screenshot below showing the runs and have also attached the data pipeline for you.

 

jennratten_0-1748344131057.png

 

View solution in original post

3 REPLIES 3
jennratten
Valued Contributor III

Hello @4019Charan  - I tested triggering dataflows Gen2 with and without CICD using dynamic content filled by parameters and variables.  The dataflow Gen2 with CICD failed with both parameters and variables while the dataflow Gen2 without CICD was successful with both parameters and variables.  Are you using dataflow gen2 with CICD?  If so, can you try it with out CICD?  I have included a screenshot below showing the runs and have also attached the data pipeline for you.

 

jennratten_0-1748344131057.png

 

Thank you @jennratten . so it does work without CICD but not with CICD. I wonder what could be the problem. But thanks for pointing that out. I really appreciate it.

4019Charan
New Contributor

Hello jennratten, so you are right I have tried to build with dataflowGen2 with CI/CD. Since I've already built out the solution is there any way that I could turn off the CI/CD to my existing dataflowGen2?

Helpful resources

Announcements
Users online (29)