gsutil

gsutil fails to upload file with “codec can't decode byte” error

生来就可爱ヽ(ⅴ<●) 提交于 2019-12-13 21:08:45
问题 I'm uploading a static website to cloud storage using the command gsutil cp -v -R -c * gs://www.gennadiy-dolzhenko.ru mid process it fails with the following output ...SNIP... Copying file://tourism_studies/models/articles/54-moskva/slideshow/resized/sk576.jpg [Content-Type=image/jpeg]... Created: gs://www.gennadiy-dolzhenko.ru/tourism_studies/models/articles/54-moskva/slideshow/resized/sk576.jpg#1403352412336000 Copying file://tourism_studies/models/articles/54-moskva/slideshow/resized/7.jpg

`gsutil cp` from Storage to compute instance running container doesn't copy files

纵然是瞬间 提交于 2019-12-13 16:21:23
问题 I am running a Google compute instance with a coreos container (image name: coreos-stable-1688-4-0-v20180327 ). Copying files from Storage to the local filesystem with gsutil seems to work fine -- except that none of the supposedly copied files actually appears on the filesystem. Running the same copy command on a compute instance without using a container does work, so I imagine the issue is with the container. However, I'm not sure what about the container is causing the copy to fail. The

gsutil cp hangs on obtain initial access_token

浪子不回头ぞ 提交于 2019-12-13 00:37:16
问题 When using gsutil to copy a file it hangs indefinitely: gsutil cp gs://gcp-public-data-sentinel-2/index.csv.gz . Running gsutil with with debugging gsutil -D cp outputs: gsutil version: 4.28n boto version: 2.48.0 python version: 2.7.13 |Anaconda custom (64-bit)| (default, Dec 20 2016, 23:09:15) [GCC 4.4.7 20120313 (Red Hat 4.4.7-1)] OS: Linux 2.6.32-504.23.4.el6.x86_64 multiprocessing available: True using cloud sdk: True pass cloud sdk credentials to gsutil: True config path(s): /home

Unable to import gsutil

不问归期 提交于 2019-12-12 15:07:45
问题 I feel I set everything up correctly. I followed these instructions. and installed from the tar file. My home directory has a folder "gsutil" now. I ran through the configuration to set my app up for oauth2, and am able to call gsutil from the command line. To use gsutil and Google App Engine, I added the following lines to the .bashrc file in my Home directory and sourced it: export PATH=$PATH:$HOME/google_appengine export PATH=${PATH}:$HOME/gsutil export PYTHONPATH=${PYTHONPATH}:$HOME

GSUtil rsync gives a 400 non-retryable exception on S3 bucket

邮差的信 提交于 2019-12-12 13:15:24
问题 I'm using gsutil rsync, copying from s3 to gs, and I'm getting the following error after gsutil has gone partway through a bucket: Caught non-retryable exception while listing s3://[bucket]/: BadRequestException: 400 None CommandException: Caught non-retryable exception - aborting rsync This is undesirable behavior, because I can manually copy from s3 to gs other files. I can't bypass by using the "-C" switch, since this isn't an error in copying. Edit: Appears that if a "#" is in a filename

gsutil returning “no matches found”

巧了我就是萌 提交于 2019-12-12 08:19:39
问题 I'm trying using gsutil to remove the contents of a Cloud Storage bucket (but not the bucket itself). According to the documentation, the command should be: gsutil rm gs://bucket/** However, whenever I run that (with my bucket name substituted of course), I get the following response: zsh: no matches found: gs://my-bucket/** I've checked permissions, and I have owner permissions. Additionally, if I specify a file, which is in the bucket, directly, it is successfully deleted. Other information

gsutil: Can't touch a file with brackets in the name

杀马特。学长 韩版系。学妹 提交于 2019-12-12 03:24:11
问题 $ gsutil du -sh gs://test123/ CommandException: Cloud folder gs://test123/testfile[1994]/ contains a wildcard; gsutil does not currently support objects with wildcards in their name. $ gsutil mv gs://test123/testfile[1994]/ gs://test123/testfile_1994/ CommandException: Cloud folder gs://test123/testfile[1994]/ contains a wildcard; gsutil does not currently support objects with wildcards in their name. $ gsutil mv "gs://test123/testfile\[1994\]/" gs://test123/testfile_1994/ CommandException:

gsutil command crashes every time on Windows 10

ぐ巨炮叔叔 提交于 2019-12-11 14:49:44
问题 Whenever I run some gsutil command, for example gsutil components update , it exits with this error: ERROR: gcloud crashed (LookupError): unknown encoding: cp65001 If you would like to report this issue, please run the following command: gcloud feedback To check gcloud for common problems, please run the following command: gcloud info --run-diagnostics Running gloud info --diagnostics as it suggests also fails with the same error: Network diagnostic detects and fixes local network connection

Can't call gsutil config in google cloud sdk?

为君一笑 提交于 2019-12-11 14:26:03
问题 I have downloaded latest google cloud sdk. Now I want to use gsutil. Whatever command I call on gsutil, I get the same error: Traceback (most recent call last): File "D:\Programs\Google\Cloud SDK\google-cloud-sdk\bin\..\bin\bootstrapping\g sutil.py", line 102, in <module> main() File "D:\Programs\Google\Cloud SDK\google-cloud-sdk\bin\..\bin\bootstrapping\g sutil.py", line 55, in main boto_path = os.pathsep.join(path_parts) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position 9

Deletion of users (identities) from Google bucket IAM Policy does not work

喜欢而已 提交于 2019-12-11 14:17:42
问题 In order to remove identities from a google cloud bucket, I use the example provided at the GCP examples repo: here. I am wondering if there is something I am missing, I have the correct root credentials to the cloud account, as well as the project ownership credentials. Basically, the removal operations do not owrk both from Java code and using the gsutil function from gcp web console. Here is the original policy: Policy{ bindings= { roles/storage.legacyBucketOwner= [ projectOwner:csbauditor