Stackdriver logs not available for Cloud ML jobs since migration to V2

Question

Since migration to V2 logs from Cloud ML jobs are not accessible on the Stackdriver logging console anymore. The last log displayed is

Waiting for Tensorflow to         


        

Answer 1

There are no known issues with Cloud ML's Stackdriver logging. The fact that you see "Waiting for Tensorflow to start." indicates you are seeing log messages from Cloud ML.

If logs from your Python/TensorFlow program are missing that usually indicates Cloud ML hasn't been authorized to send logs to Stackdriver logging for your project. To check permissions do the following

1. Identify the Cloud ML service account by following these instructions
2. In the Cloud Console select the IAM Tab
3. Verify that the Cloud ML service account is listed and has Logs Writer permissions