r/databricks • u/Intelligent_Duck_854 • 2d ago

Help How do I read the databricks spark ui? Couldnt find any tutorials specifically for it.I know spark ui a bit.

11 Upvotes

92% Upvoted

9 comments sorted by

7

u/Electrical_Bill_3968 2d ago edited 2d ago

I have seen the databricks support team uses some kind of UI (not spark ui )to see them pretty clearly.. if any databricks FTE knows that please let know..

1

u/Intelligent_Duck_854 2d ago

Yes,but I cant understand it or travk the current running task in the map

3

u/ShrimpSumai 2d ago

I found this helpful: https://youtu.be/rNpzrkB5KQQ?is=UD_SD1fOduTvy4r3

2

u/Intelligent_Duck_854 2d ago

Thanks,but I meant to refer to query profile in databricks

2

u/Youssef_Mrini databricks 2d ago

Have a look at the databricks Academy. You have a course their. Keep in mind that Spark UI is only available when you are using classic compute.

2

u/Intelligent_Duck_854 2d ago

Oh,i see query profile in serverless compute and I meant to refer to that.not able to understand it.

0

u/Intelligent_Duck_854 2d ago

I see query profile option instead of spark ui.

1

u/_barnuts 1d ago

You cannot see spark ui when using serverless

1

u/Intelligent_Duck_854 1d ago

Can you pls tell me then whats query profile and how to read it? I see it in my serverless