azure-storage-blobs

How to transfer files from local machine to virtual folders within an Azure container (using blobxfer)

女生的网名这么多〃 提交于 2019-12-08 04:19:48
问题 I am using blobxfer to upload some files to Azure Storage. It's like AzCopy, but for Linux OS (whereas AzCopy is for Windows). Basically, I have two folders at the location /home/myuser/s3/ . One folder is called /uploads/ , the other is called /users/ . These folders contain multitudes of image files. I need to upload both these folders to an Azure container. Keep in mind that I don't want the contents of the folders to mix on Azure storage, they need to be transferred to separate virtual

Connecting to Azure storage account thru proxy server Microsoft Azure Storage SDK for Java

只谈情不闲聊 提交于 2019-12-08 03:00:23
问题 In our project we need to access the Blob Storage through a Proxy Server (squid). We are planning to use the Microsoft Azure Storage SDK for Java version 2.2.0. But it looks like setting the proxy is not provided by the API. The only way I could make it go through the proxy is by setting the System properties System.setProperty("http.proxyHost", "127.0.0.1"); System.setProperty("http.proxyPort", "3128"); But this affect all services that are running on my JVM which harms other services that

List Files in Azure Blob Storage

浪尽此生 提交于 2019-12-08 00:27:27
I am trying to list all the jpg files in my blob. When I use this code CloudStorageAccount storageAccount1 = CloudStorageAccount.Parse(CloudConfigurationManager.GetSetting("ConnString")); CloudBlobContainer container1 = blobClient.GetContainerReference(imageFolder); var blobs = container1.ListBlobs(); All the files in that particular blob are listed I have tried to modify the above code but the modified code does not list anything. CloudStorageAccount storageAccount1 = CloudStorageAccount.Parse(CloudConfigurationManager.GetSetting("ConnString")); CloudBlobContainer container1 = blobClient

Azure Logic app : How to Send an Email with one or more attachments after getting the content from Blob storage?

不问归期 提交于 2019-12-08 00:21:48
问题 I want to read blob contents using azure logic app get blob contents connector and send that contents as attachment via email using azure logic app send email connector . Attachments could be one or more. Send email requires attachment data in following json format : [ { "ContentBytes": "@{body('Get_blob_content')}", "Name": "Test" } ] 回答1: You could add When a blob is added or modified (properties only) (Preview) as trigger to focus on the Container which you want to listen to. Then add Get

Azure BlobStorage blobs to Index

允我心安 提交于 2019-12-08 00:21:17
问题 Is it possible to upload a document to a blob storage and do the following: Grab contents of document and add to index. Grab key phrases from contents in point 1 and add to index. I want the key phrases then to be searchable. I have code that can upload documents to a blobstorage which works perfect, but the only way to get this indexed(that I know of) is by using the "Import Data" within the Azure Search service, which creates and index with predefined fields - as below: This works great

Authorization for Azure Function using Managed Service Identity to fetch blob from Azure Storage container

坚强是说给别人听的谎言 提交于 2019-12-07 20:02:42
问题 When I attempt to invoke an Azure Function in an Azure Function App using a system assigned managed identity to fetch a blob from an Azure Storage container, I’m encountering: System.Private.CoreLib: Exception while executing function:<FunctionName>. Microsoft.WindowsAzure.Storage: Unauthorized. I’m adapting the approach outlined here. Here’s the code: [FunctionName("TestFetchTileViaSvcPrinId")] public static async Task<HttpResponseMessage> RunAsync( [HttpTrigger(AuthorizationLevel.Anonymous,

Force file download for IE9 on Azure Blob Storage

女生的网名这么多〃 提交于 2019-12-07 19:01:12
问题 I am trying to use Azure Blob Storage as a location for secure file downloads using Shared Access Signature. Everything is working very well, however the problem I am having is I am trying to allow the user to save files from the browser and I have all browsers except IE9 working. Reviewing this question, What content type to force download of text response? this works well when I can control all of the headers, however in Azure Blob Storage, I have set the Content-Type to application/octet

Programmatically get Azure storage account properties

微笑、不失礼 提交于 2019-12-07 13:46:34
问题 I wrote in my C# web application a method that deletes old blobs from Azure storage account. This is my code: public void CleanupIotHubExpiredBlobs() { const string StorageAccountName = "storageName"; const string StorageAccountKey = "XXXXXXXXXX"; const string StorageContainerName = "outputblob"; string storageConnectionString = string.Format("DefaultEndpointsProtocol=https;AccountName={0};AccountKey={1}", StorageAccountName, StorageAccountKey); // Retrieve storage account from connection

How to resolve an InvalidMd5 error returned from the Windows Azure Blob Storage service?

半城伤御伤魂 提交于 2019-12-07 13:00:05
问题 I am building an application that needs to allow users to upload large images (up to about 100 MB) to the Windows Azure Blob Storage service. Having read Rob Gillen's excellent article on file upload optimization for Windows Azure, I borrowed his approach for doing parallel upload of file chunks, using the CloudBlockBlob.PutBlock() method within a Parallel.For loop (code is available here). The problem I have is that whenever I try to upload a file I get an "InvalidMd5" exception from the

Azure storage get_blob_to_stream cant download saved csv file as stream

青春壹個敷衍的年華 提交于 2019-12-07 11:56:48
问题 I want to download a CSV file stored in Azure storage into a stream and directly used in my python script, but after I did this with help from Thomas, I cannot use pandas read_csv method, the error message is: pandas.io.common.EmptyDataError: No columns to parse from file,thus I assume the download CSV stream is actually empty, but after check in storage account, the CSV file is fine with all data inside it, what the problem here? below is the code from Thomas: from azure.storage.blob import