load image dataset (folder or zip) located in Google Drive to Google Colab?

前端 未结 3 695
礼貌的吻别
礼貌的吻别 2020-12-29 10:36

I have a dataset of images on my Google Drive. I have this dataset both in a compressed .zip version and an uncompressed folder.

I want to train a CNN using Google C

相关标签:
3条回答
  • 2020-12-29 11:16

    Other answers are excellent, but they require everytime to authenticate in Google Drive, that is not very comfortable if you want to run top down your notebook.

    I had the same need, I wanted to download a single zip file containing dataset from Drive to Colab. I preferred to get shareable link of that file and run following cell (substitute drive_url with your shared link):

    import urllib
    
    drive_url = 'https://drive.google.com/uc?export=download&id=1fBVMX66SlvrYa0oIau1lxt1_Vy-XYZWG'
    file_name = 'downloaded.zip'
    
    urllib.request.urlretrieve(drive_url, file_name)
    print('Download completed!')
    
    0 讨论(0)
  • 2020-12-29 11:26

    As mentioned by @yl_low here

    Step 1:

    !apt-get install -y -qq software-properties-common python-software-properties module-init-tools
    !add-apt-repository -y ppa:alessandro-strada/ppa 2>&1 > /dev/null
    !apt-get update -qq 2>&1 > /dev/null
    !apt-get -y install -qq google-drive-ocamlfuse fuse
    

    Step 2:

    from google.colab import auth
    auth.authenticate_user()
    

    Step 3:

    from oauth2client.client import GoogleCredentials
    creds = GoogleCredentials.get_application_default()
    import getpass
    !google-drive-ocamlfuse -headless -id={creds.client_id} -secret={creds.client_secret} < /dev/null 2>&1 | grep URL
    vcode = getpass.getpass()
    !echo {vcode} | google-drive-ocamlfuse -headless -id={creds.client_id} -secret={creds.client_secret}
    

    Both Step 2 and 3 will require to fill in the verification code provided by the URLs

    Step 4:

    !mkdir -p drive
    !google-drive-ocamlfuse drive
    

    Step 5:

    print('Files in Drive:')
    !ls drive/
    
    0 讨论(0)
  • 2020-12-29 11:28

    To update the answer. You can right now do it from Google Colab

    # Load the Drive helper and mount
    from google.colab import drive
    
    # This will prompt for authorization.
    drive.mount('/content/drive')
    
    !ls "/content/drive/My Drive"
    

    Google Documentation

    0 讨论(0)
提交回复
热议问题