Minio

Minio 分布式集群部署

由 房东的猫 提交于 2020-02-26 19:23:48
集群安装 一、基础环境 操作系统：CentOS 7.3 Minio下载 二、准备工作 2.1、机器资源 172.30.1.177 /apps/minio/data1 /apps/minio/data2 172.30.1.180 /apps/minio/data1 /apps/minio/data2 本集群由2台服务器构成，每个服务器上挂载两个目录 三、编写集群启动脚本（所有节点配置文件相同） vim /opt/minio/run.sh #!/bin/bash export MINIO_ACCESS_KEY=admin export MINIO_SECRET_KEY=adminsecret nohup /apps/minio/bin/minio server \ http://172.30.1.177/apps/minio/data1 http://172.30.1.177/apps/minio/data2 \ http://172.30.1.180/apps/minio/data1 http://172.30.1.180/apps/minio/data2 \ 2>&1 1>/apps/minio/logs/running.log & 其中，“MINIO_ACCESS_KEY”为用户名，“MINIO_SECRET_KEY”为密码，密码不能设置过于简单，不然minio会启动失败四

Is there a way to stream data directly from python request to minio bucket

由 ＊爱你＆永不变心＊ 提交于 2020-02-25 04:16:51
问题 I am trying to make a GET request to a server to retrieve a tiff image. I then want to stream it directly to MinIO using the put_object method in the MinIO python SDK. I know I could do this by saving the image to a temp file, then uploading but I wanted to see if I could skip that step. I've tried inserting the byte response directly and using BytesIO to wrap it but I think I am missing something. r = requests.get(url_to_download, stream=True) Minio_client.put_object("bucket_name", "stream

Is there a way to stream data directly from python request to minio bucket

由 戏子无情 提交于 2020-02-25 04:16:42
问题 I am trying to make a GET request to a server to retrieve a tiff image. I then want to stream it directly to MinIO using the put_object method in the MinIO python SDK. I know I could do this by saving the image to a temp file, then uploading but I wanted to see if I could skip that step. I've tried inserting the byte response directly and using BytesIO to wrap it but I think I am missing something. r = requests.get(url_to_download, stream=True) Minio_client.put_object("bucket_name", "stream

Is there a way to stream data directly from python request to minio bucket

由 别说谁变了你拦得住时间么 提交于 2020-02-25 04:16:25
问题 I am trying to make a GET request to a server to retrieve a tiff image. I then want to stream it directly to MinIO using the put_object method in the MinIO python SDK. I know I could do this by saving the image to a temp file, then uploading but I wanted to see if I could skip that step. I've tried inserting the byte response directly and using BytesIO to wrap it but I think I am missing something. r = requests.get(url_to_download, stream=True) Minio_client.put_object("bucket_name", "stream

Is there a way to stream data directly from python request to minio bucket

由 冷暖自知 提交于 2020-02-25 04:16:10
问题 I am trying to make a GET request to a server to retrieve a tiff image. I then want to stream it directly to MinIO using the put_object method in the MinIO python SDK. I know I could do this by saving the image to a temp file, then uploading but I wanted to see if I could skip that step. I've tried inserting the byte response directly and using BytesIO to wrap it but I think I am missing something. r = requests.get(url_to_download, stream=True) Minio_client.put_object("bucket_name", "stream

Is there a way to stream data directly from python request to minio bucket

由 回眸只為那壹抹淺笑 提交于 2020-02-25 04:16:07
问题 I am trying to make a GET request to a server to retrieve a tiff image. I then want to stream it directly to MinIO using the put_object method in the MinIO python SDK. I know I could do this by saving the image to a temp file, then uploading but I wanted to see if I could skip that step. I've tried inserting the byte response directly and using BytesIO to wrap it but I think I am missing something. r = requests.get(url_to_download, stream=True) Minio_client.put_object("bucket_name", "stream

k8s, Ingress, Minio, and a Static Site

由 一个人想着一个人 提交于 2020-01-06 08:43:34
问题 We have a k8s cluster with an nginx Ingress and Minio installed. In Minio I have a bucket called tester with a hello world index.html file. I used the Minio MC client to set the tester bucket to public. Now I am able to see the hello world file when I visit my (altered) minio url like so: https://minio.example.com/tester/index.html . My goal is to set up an Ingress resource to access the public bucket. Here is my manifest to try and do so, however I only ever get a 404 error . . . ingress

gitlab-ci cache on kubernetes with minio-service not working anymore

由 a 夏天 提交于 2020-01-04 05:43:09
问题 I'm running gitlab 10.4.3 with gitlab-runner 10.4.0 as a kubernetes deployment with kubernetes runner and a minio-server for caching. I installed it according to the gitlab docs. Everything worked with the cache as expected, when adding the appropriate settings to the .gitlab-ci.yml -file: build: stage: build variables: GIT_STRATEGY: fetch cache: key: "$CI_BUILD_REF_NAME" paths: - node_modules/ script: - compile-templates.sh - yarn install - yarn run build The pipeline output did fill the

How to override endpoint in AWS-SDK-CPP to connect to minio server at localhost:9000

由 狂风中的少年 提交于 2019-12-08 04:50:27
问题 I tried something like: Aws::Client::ClientConfiguration config; config.endpointOverride = Aws::String("localhost:9000"); It does not work. It seems that AWS-SDK-CPP by default uses virtual hosting: https://bucket-name/s3.amazonaws.com However, to access Minio, we need path style access: https://localhost:9000/minio/bucket-name In AWS-SDK-JAVA, there is: AmazonS3ClientBuilder.withPathStyleAccessEnabled(true) is there something similar in AWS-SDK-CPP? 回答1: The switch between path style and

How to override endpoint in AWS-SDK-CPP to connect to minio server at localhost:9000

由 試著忘記壹切 提交于 2019-12-06 15:43:23
I tried something like: Aws::Client::ClientConfiguration config; config.endpointOverride = Aws::String("localhost:9000"); It does not work. It seems that AWS-SDK-CPP by default uses virtual hosting: https://bucket-name/s3.amazonaws.com However, to access Minio, we need path style access: https://localhost:9000/minio/bucket-name In AWS-SDK-JAVA, there is: AmazonS3ClientBuilder.withPathStyleAccessEnabled(true) is there something similar in AWS-SDK-CPP? The switch between path style and virtual hosting is in S3Client constructor: S3Client(const Aws::Client::ClientConfiguration&
订阅 Minio