Some YARN logs are not visible in YARN UI despite job succeeding

Question

I have a Spark application that runs on YARN and occasionally for some applications I see logs not showing up in YARN UI. I see log aggregation diagnostics telling me that l