azure-blob-storage

Read in azure blob using python

蹲街弑〆低调 提交于 2020-01-16 08:41:43
问题 I want to read an excel file stored in Azure blob storage to a python data frame. What method would I use? 回答1: There is a function named read_excel in the pandas package, which you can pass a url of an online excel file to the function to get the dataframe of the excel table, as the figure below. So you just need to generate a url of a excel blob with sas token and then to pass it to the function. Here is my sample code. Note: it requires to install Python packages azure-storage , pandas and

azure blob parallel blob deleting

微笑、不失礼 提交于 2020-01-15 09:03:33
问题 I want to fast delete many blobs from azure storage. Azure method for delete blob is awaitable. I have more than 1000 blobs to delete. My question is if it is faster to delete blobs in parallel, for example in 20 parallel tasks? 来源: https://stackoverflow.com/questions/56022917/azure-blob-parallel-blob-deleting

Loading file from Azure Blob Storage into Azure SQL Database using BULK INSERT

旧巷老猫 提交于 2020-01-14 03:12:06
问题 Following this announcement https://azure.microsoft.com/en-gb/updates/preview-loading-files-from-azure-blob-storage-into-sql-database/ I tried the example as such provided in this GitHub sample and receiving the following error, -- Create credential with Azure Blob SAS CREATE DATABASE SCOPED CREDENTIAL xxxstorcred WITH IDENTITY = 'SHARED ACCESS SIGNATURE', SECRET = '?sv=2015-12-11&ss=bfqt&srt=sco&sp=rwdl&st=2017-03-14T17%3A52%3A00Z&se=2017-05-31T16%3A52%3A00Z&sig

How to upload zip file to azure blob then unzip it there [closed]

江枫思渺然 提交于 2020-01-13 08:26:08
问题 Closed . This question needs details or clarity. It is not currently accepting answers. Want to improve this question? Add details and clarify the problem by editing this post. Closed 2 years ago . I have lot of zip files, which will have few folders and 50+ files in it. How can I upload those zip files to azure blob then unzip it there. Unzipping the file in server and uploading files in it one by one to azure blob will be a cumbersome process. Does azure has any easy way to achieve this or

Uploading a Azure blob directly to SFTP server without an intermediate file

老子叫甜甜 提交于 2020-01-10 20:08:19
问题 I'm attempting to upload am Azure blob directly to an SFTP server. It's simple to upload a file from a local location: using (var sftp = new SftpClient(connectionInfo)){ sftp.Connect(); using (var uplfileStream = System.IO.File.OpenRead(fileName)){ sftp.UploadFile(uplfileStream, fileName, true); } sftp.Disconnect(); } Is there a way to copy blobs from blob storage directly to an SFTP server? 回答1: Either combine CloudBlob.OpenRead with SftpClient.UploadFile: using (var blobReadStream =

Access remote file contents as a stream using WinSCP .NET assembly

我的未来我决定 提交于 2020-01-10 03:05:07
问题 I am trying to open file to read from SFTP using WinSCP .NET assembly as par to my exercise to archive file from SFTP to Azure blob. To upload a blob to Azure, I am using using (var fileStream = inputStream) { blockBlob.UploadFromStream(fileStream); blobUri = blockBlob.Uri.ToString(); } How to get the stream from the file on SFTP server? I managed using SftpClient to get the stream using the following code and it works but unfortunately not able to achieve the same using WinSCP .NET assembly.

Pushing documents(blobs) for indexing - Azure Search

百般思念 提交于 2020-01-06 04:41:07
问题 I've been working in Azure Search + Azure Blob Storage for while, and I'm getting trouble indexing the incremental changes for new files uploaded. How can I refresh the index after upload a new file into my blob container? Following my steps after upload file(I'm using rest service to perform these actions): I'm using the Microsoft Azure Storage Explorer [link]. Through this App I've uploaded my new file to a folder already created before. After that, I used the Http REST to perform a 'Run'

Azure WebJobs Blob Trigger - multiple resizes

ぃ、小莉子 提交于 2020-01-06 04:03:11
问题 I'm attempting to create C# Azure WebJob which is triggered on a new Blob creation to resize the uploaded image into three different sizes. I found and followed this great tutorial. There are two sections, the first portion "works" but enters into a recursion loop as the creation of the three new sizes triggers the script, which creates three more instances for each of three new images, so forth and so forth. This was intentional, to highlight the need for the final implementation. Here is

Azure WebJobs Blob Trigger - multiple resizes

微笑、不失礼 提交于 2020-01-06 04:03:09
问题 I'm attempting to create C# Azure WebJob which is triggered on a new Blob creation to resize the uploaded image into three different sizes. I found and followed this great tutorial. There are two sections, the first portion "works" but enters into a recursion loop as the creation of the three new sizes triggers the script, which creates three more instances for each of three new images, so forth and so forth. This was intentional, to highlight the need for the final implementation. Here is

Export SQL Azure db to blob - Start-AzureSqlDatabaseExport : Cannot convert AzureStorageContainer to AzureStorageContainer

不想你离开。 提交于 2020-01-04 04:55:31
问题 I am using this code found on stack , and all connections are correct. Import-Module Azure Import-Module Azure.Storage Get-AzureRmSubscription –SubscriptionName “Production” | Select-AzureRmSubscription # Username for Azure SQL Database server $ServerLogin = "username" # Password for Azure SQL Database server $serverPassword = ConvertTo-SecureString "abcd" -AsPlainText -Force # Establish credentials for Azure SQL Database Server $ServerCredential = new-object System.Management.Automation