google-cloud-logging

Google App Engine why some Logs are not getting shown?

别来无恙 提交于 2019-12-05 10:41:09
In Google App Engine Flexible environment many Logs are skipping, and not getting shown in the Logging console, and it is happening always, I am checking it on Stackdriver Logging section on Google Cloud dashboard, the Logs I am showing using console.log() are getting skipped but mongoose query logs are getting printed. Also, now currently sometimes my logs console.logs are getting shown but sometimes not, but previously they were getting shown every time. Why now is it not working every time? Can anyone please tell me why is this happening? Thank You Edit - I have added debugging points but

Error using Google Stackdriver Logging in App Engine Standard python

风格不统一 提交于 2019-12-04 11:00:58
问题 My Stack: Google App Engine Standard Python (2.7) Goal: To create named logs in Google Stackdriver Logging, https://console.cloud.google.com/logs/viewer Docs - Stackdriver Logging: https://google-cloud-python.readthedocs.io/en/latest/logging/usage.html Code: from google.cloud import logging as stack_logging from google.cloud.logging.resource import Resource import threading class StackdriverLogging: def __init__(self, resource=Resource(type='project', labels={'project_id': 'project_id'}),

Error using Google Stackdriver Logging in App Engine Standard python

空扰寡人 提交于 2019-12-03 06:49:41
My Stack: Google App Engine Standard Python (2.7) Goal: To create named logs in Google Stackdriver Logging, https://console.cloud.google.com/logs/viewer Docs - Stackdriver Logging: https://google-cloud-python.readthedocs.io/en/latest/logging/usage.html Code: from google.cloud import logging as stack_logging from google.cloud.logging.resource import Resource import threading class StackdriverLogging: def __init__(self, resource=Resource(type='project', labels={'project_id': 'project_id'}), project_id='project_id'): self.resource = resource self.client = stack_logging.Client(project=project_id)

Output from Dataproc Spark job in Google Cloud Logging

女生的网名这么多〃 提交于 2019-12-01 15:03:41
Is there a way to have the output from Dataproc Spark jobs sent to Google Cloud logging? As explained in the Dataproc docs the output from the job driver (the master for a Spark job) is available under Dataproc->Jobs in the console. There are two reasons I would like to have the logs in Cloud Logging as well: I'd like to see the logs from the executors. Often the master log will says "executor lost" with no further detail, and it would be very useful to have some more information about what the executor is up to. Cloud Logging has nice filtering and search Currently the only output from

Output from Dataproc Spark job in Google Cloud Logging

别说谁变了你拦得住时间么 提交于 2019-12-01 14:41:16
问题 Is there a way to have the output from Dataproc Spark jobs sent to Google Cloud logging? As explained in the Dataproc docs the output from the job driver (the master for a Spark job) is available under Dataproc->Jobs in the console. There are two reasons I would like to have the logs in Cloud Logging as well: I'd like to see the logs from the executors. Often the master log will says "executor lost" with no further detail, and it would be very useful to have some more information about what

Logging to the Google Cloud in Google Container/Compute Engine with Go

亡梦爱人 提交于 2019-12-01 05:22:38
I have a GKE application with 20 nodes running Go. I would like to consolidate all the logs to view in the Google Developers Console log viewer, but I am having 2 problems. I can't get severity filtering, and each newline in my log message starts a new log entry in the viewer (problematic with newlines in the log). I have the google-fluent-d setup so all stdout gets logged in the cloud, and I have made use of log.Lshortfile, call depth and log.Logger.Output to get filename and line number from the "log" library. I've looked at this library: "google.golang.org/cloud/logging" but I am having

Logging to the Google Cloud in Google Container/Compute Engine with Go

吃可爱长大的小学妹 提交于 2019-12-01 03:24:37
问题 I have a GKE application with 20 nodes running Go. I would like to consolidate all the logs to view in the Google Developers Console log viewer, but I am having 2 problems. I can't get severity filtering, and each newline in my log message starts a new log entry in the viewer (problematic with newlines in the log). I have the google-fluent-d setup so all stdout gets logged in the cloud, and I have made use of log.Lshortfile, call depth and log.Logger.Output to get filename and line number

Logs are Not Nested Under Requests in Flexible VM

两盒软妹~` 提交于 2019-11-28 12:06:22
I have a module running in App Engine Classic and another module running in App Engine Flexible. When viewing logs running in App Engine Classic, the log entries are nested within each request. However, when viewing logs running in App Engine Flexible, they are not nested. Each log entry appears to be unconnected from the request. This makes it very difficult to determine which log is associated with which request. Is it possible to get the logs in App Engine Flexible to be nested under each request (as they are with App Engine Classic)? I cannot find anything in the documentation that

Logs are Not Nested Under Requests in Flexible VM

自闭症网瘾萝莉.ら 提交于 2019-11-27 06:45:55
问题 I have a module running in App Engine Classic and another module running in App Engine Flexible. When viewing logs running in App Engine Classic, the log entries are nested within each request. However, when viewing logs running in App Engine Flexible, they are not nested. Each log entry appears to be unconnected from the request. This makes it very difficult to determine which log is associated with which request. Is it possible to get the logs in App Engine Flexible to be nested under each

How do I map my java app logging events to corresponding cloud logging event levels in GCP Felexible non-compat App Engine?

时间秒杀一切 提交于 2019-11-26 21:17:45
问题 I am new to GCP AppEngine and I chose the Flexible environment for several reasons. However, I am shocked to find out that the flexible environment's non-"compatible" runtimes appear to not allow me to map my app's logging events to the appropriate log levels in cloud logging. Am I reading this correctly? https://cloud.google.com/appengine/docs/flexible/java/writing-application-logs#writing_application_logs_1 And this page was really unhelpful. https://cloud.google.com/java/getting-started