What is 'Active Jobs' in Spark History Server Spark UI Jobs section
问题 I'm trying to understand Spark History server components. I know that, History server shows completed Spark applications. Nonetheless, I see 'Active Jobs' set to 1 for a completed Spark application. I'm trying to understand what is 'Active Jobs' mean in Jobs section. Also, Application completed within 30 minutes, but when I opened History Server after 8 hours, 'Duration' shows 8.0h. Please see the screenshot. Could you please help me understand 'Active Jobs', 'Duration' and 'Stages: Succeeded