Question 1:
We have our table stored in the format abfss://container@storageaccount.dfs.core.windows.net/gold/table_name/full. When creating a shortcut from the API, the table is placed in an unidentified folder within the Tables section. It works correctly if table were in format abfss://container@storageaccount.dfs.core.windows.net/gold/table_name/ which is not in our case. How can we use "adlsGen2" in our case.
For now first we are creating shortcut for the container and then using "oneLake" target in api we are giving file path.
payload = json.dumps({
"name": table_name,
"path": "Tables/"+table_name,
"target": {
"adlsGen2": {
"location": "https://+storage_account.dfs.core.windows.net",
"subpath": "/gold/table_name/full",
"connectionId": connection_id
}
}
})
Question 2:
My spn have access to a lake house folder3 and not in any of the parent folder. in https://storageaccount.dfs.core.windows.net/container/folder1/folder2/folder3. In databricks i am able to list folder3 data not fails while accessing folder2 because spn doesn't have access on that. I am not able to manually creating shortcut on folder3. It is creating on container and when i try to expand the container to see folder1 then it fails and says spn doesnot have access.
My question is to access folder3 do i need access at parent folder too? my client won't provide me the access can you give possible solution.
