optimization of notebook taking data from salesforce

[ivannye]

Hi Guys,

I would like to optimize this query. It run every 5 minutes but it takes a lot of ressources. I would appreciate any help to optimize it please.

Edit: I deleted the code as I have found the solution. Thanks everyone

[lbendlin]

Please be more specific.  Which part of the process takes the longest time, and what are "resources"  ?  Memory?  API calls?

[ivannye]

Mostly memory and capacity utilization

[Anonymous · Accepted solution]

HI @ivannye,

It seems like you are handling query data from data base that only applied one filter by datetime and return with many columns.

Have you tried to limit the result row numbers such as pagination effect or only execute one simple query each time? They should reduce the resource usages. 

Also you can try to only return the key field ID list from table, then you can use these IDs as condition to filter records to return the table with wanted fields.

Regards,

Xiaoxin Sheng

[Anonymous]

Hi @ivannye ,

Any update on this? Did the above suggestions help with your scenario? if that is the case, you can consider Kudo or Accept the helpful suggestions to help others who faced similar requirements.

If these also don't help, please share more detailed information and description to help us clarify your scenario to test.

Regards,

Xiaoxin Sheng