Azure DevOps task inline script with powershell does not fails the task on error

Question

In the Azure DevOps release pipeline I run Inline Script as part of Post Deployment Action of Azure App Service Deploy task. The inline script looks like this: