app-engine-flexible

Why does Dataflow erratically fail in Datastore access?

孤者浪人 提交于 2019-12-08 04:13:42
问题 My simple Dataflow pipeline successfully copies multiple Kinds from one project's Datastore to another in most cases. But in certain Kinds (about 5% of them), we always get these errors. Dataflow retries 4-8 times with a delay of about 75 seconds, and then the pipeline fails. How can I diagnose and resolve this? EDIT: The answer includes: (1) there was a bug in the Datastore library used by Dataflow; after they fixed this bug, you can see the underlying cause and (2) the default batch size

Can you use fractional vCPUs with GAE Flexible Environment?

|▌冷眼眸甩不掉的悲伤 提交于 2019-12-07 09:22:30
问题 I'm transitioning an application from GCE to GAE Flexible. It's currently running in a g1-small instance which is plenty for my needs, however when I try to specify a g1-small instance in my app.yaml : resources: cpu: 0.5 memory_gb: 1.7 I can deploy but there's no indication that a smaller instance is actually being used. After deploying, there's no indication that my app is running with the smaller instance size. How can I use fractional vCPUs with the flexible environment? Thanks! 回答1:

How to restrict access to GAE Flexible site only for GSuite account?

别等时光非礼了梦想. 提交于 2019-12-06 14:39:17
How to restrict access to GAE Flexible site only for all account from my domain in GSuite and eventually other Google accounts that I provide explicitely. AFAIR there where something simillar in Standard GAE version in app.yaml handlers section. So my scenario: prodution versions restricted until go-live dev and stage version restricted permanently I would like to do this on the IAM level, to reject traffic to the site. But I didn't found anything in docs. Dzinek Ok, after rethink the problem and dig deeper in a documentation I found a page about dev environment - https://cloud.google.com

How to Change the Size of /dev/shm in App Engine Flexible

只愿长相守 提交于 2019-12-06 08:22:45
问题 How do you change the size of the shared memory folder /dev/shm in an App Engine Flexible app? By default it is set to 64M, too low to run many apps (e.g., chrome). I don't see any way to change it. There are ways to change it if you have access to the docker run command, but we don't have such access when launching app engine flexible apps. 回答1: A: No. Unfortunately this isn't possible (yet?) with appengine. More than a few people have run into this issue. For some reason, the container

How to install new software onto a GCP flexible environment VM

核能气质少年 提交于 2019-12-06 01:38:27
I have a ruby on rails app running on a Google Cloud Platform VM running on the app engine flexible environment. It looks like it installs most of the software on the VM when I deploy the app with gcloud --project project-name preview app deploy I think it installs rails and other software from reading the temporary dockerfile it creates. It grabs the info for the dockerfile from the app.yaml file (I got this setup from following their tutorials). This was working fine for me but now I need to install ImageMagick onto the server to manipulate images on the site. Normally you do this by running

Error Deploying GAE Flex Service

孤者浪人 提交于 2019-12-05 23:06:27
Using gcloud app deploy to deploy a flex service (SDK version 127.0.0), I get the following error: ERROR: (gcloud.app.deploy) Error Response: [3] Docker image us.gcr.io/my-project-name/appengine/my-service.20161012t140507:latest was either not found, or is not in Docker V2 format. Please visit https://cloud.google.com/container-registry/docs/ui I've checked my container registry, and I can see the image has uploaded and is indeed a v2 image: The logo indicates it's a) the image is there and b) the image is not in v1 format as per https://cloud.google.com/container-registry/docs/ui .

Can you use fractional vCPUs with GAE Flexible Environment?

 ̄綄美尐妖づ 提交于 2019-12-05 14:44:28
I'm transitioning an application from GCE to GAE Flexible. It's currently running in a g1-small instance which is plenty for my needs, however when I try to specify a g1-small instance in my app.yaml : resources: cpu: 0.5 memory_gb: 1.7 I can deploy but there's no indication that a smaller instance is actually being used. After deploying, there's no indication that my app is running with the smaller instance size. How can I use fractional vCPUs with the flexible environment? Thanks! There is no way to use shared (fractional) CPUs on App Engine Flexible at the moment; The number of CPUs you

Datastore on flex nodejs appengine stopped working - bad gateway 502

假如想象 提交于 2019-12-05 05:42:56
问题 After making some updates to an app I'm working on, I pushed the app up via gcloud app deploy --version dev and everything seemed to push just fine, but upon further inspection, any of my calls (get or post) that use the @google-cloud/datastore package fail with Bad Gateway 502 - nginx error. I've put in console.logs everywhere and they never get past the line before any datastore.whatever() calls. tested with .save, .runQuery, and .update. Weirder still, i can access the datastore just fine

What are default VPC firewall rules for App Engine Flex

青春壹個敷衍的年華 提交于 2019-12-05 02:23:00
问题 I have a few services deployed in one App Engine flexible environment project. The service instances are running in the same VPC network (not default) which is specified in their app.yaml files and assigned IP addresses from the same subnetwork. By default both services are accessible from outside and I want to configure firewall rules to leave only the default service allowed for incoming traffic. So as the first step I'm configuring a rule to deny all ingress for all instances in this VPC,

How to Change the Size of /dev/shm in App Engine Flexible

流过昼夜 提交于 2019-12-04 14:57:16
How do you change the size of the shared memory folder /dev/shm in an App Engine Flexible app? By default it is set to 64M, too low to run many apps (e.g., chrome). I don't see any way to change it. There are ways to change it if you have access to the docker run command , but we don't have such access when launching app engine flexible apps. A: No. Unfortunately this isn't possible (yet?) with appengine. More than a few people have run into this issue. For some reason, the container default for /dev/shm is crazy small. ...but there are other options If the process you want to run has the