I am using the below to get the stack information I want via AWS Cli:
aws cloudformation --region ap-southeast-2 describe-stacks --stack-name mystack
I got the answer, use the below:
--query "Stacks[0].Outputs[?OutputKey=='DbUrl'].OutputValue" --output text
Hope this will help someone.