I marked a thread as a duplicate of this one but the author was also looking for the Tasks window. Adding this answer to be clear that it is under the same menu option in newer versions of Visual Studio.
As per the answer, you need to be in debug mode for this option to show up.