Download files and folders from Google Storage bucket to a local folder [closed]

Answer 1

Take a look of the gsutil tool. You can use the cp command with the -R (recursive) and -m (multithreading) option.

gsutil -m cp -R gs://<bucket_name> .

And if you want to try it with a public bucket try

gsutil -m cp -R gs://uspto-pair .

The speedup granted by multithreading can be quite significant:

$ time gsutil cp -R gs://uspto-pair/docs/2010-08-28 .
...

real    0m12.534s

vs

$ time gsutil -m cp -R gs://uspto-pair/docs/2010-08-28 .
...

real    0m3.345s

Answer 2

In my case, what worked was navigating to the bucket in the browser gui and left clicking the file and "Save file".
This is obviously terrible for multiple files, but you can compress them of course to one file (using the google cloud console).

see this thread.

Also, if you don't have a bucket, you can create one, and then upload to it using gcloud console, e.g. gsutil cp file.tgz gs://<bucket>

Answer 3

Here is what worked for me:

Step 1: install gsutil on your local machine: https://cloud.google.com/storage/docs/gsutil_install?hl=fr

Step 2: copy files from bucket to your local machine running the command: gsutil cp [-r if repository] gs://[BUCKET_NAME]/[OBJECT_NAME] [OBJECT_DESTINATION_IN_LOCAL]

Answer 4

For those wanting to avoid installing local tools like gsutil, there is a way to download files and folders from Google Cloud Storage entirely in the browser:

1. Navigate to: https://console.cloud.google.com/storage/browser/BUCKET_NAME
2. Find the folder/file you want to download.
3. At the top-right of the page, press the code icon to open the Cloud Shell.
4. Create a temporary folder in the Cloud Shell virtual-machine: mkdir Data
5. Copy the Cloud Storage data to the temporary Data folder: gsutil -m cp -R gs://BUCKET_NAME/FOLDER_OR_FILE_PATH ./Data
6. Copy the data into a zip file: zip -r Data.zip Data
7. Download the zip file by running dl Data.zip, or: opening the "..." dropdown in the toolbar, pressing "Download file", typing Data.zip, and pressing "Download".

As an alternative to steps 6 and 7 (or if you want a tar file instead of a zip):

. . 6b. Press the computer icon (or pencil) in the toolbar, to open the Cloud Shell Environment explorer in a new tab.
. . 7b. Right click the Data folder in the directory browser to the left, and press "Download". A tar file will be downloaded to your local machine, which you can then extract using 7-Zip or the like.

Answer 5

In case gsutil is throwing an exception (CommandException: Wrong number of arguments for "cp" command.) try the following:

gsutil -m cp -R gs://BUCKETNAME ./LOCALFOLDERNAME