44 questions
9
votes
1
answer
2k
views
How to get jwt token value in spring webflux? (to exchange it with Minio STS token)
I have sping-boot application with rest services written using Spring web flux.
For now I access minio using login/password authorizaton and it works fine.
For now I want to exchange application JWT ...
21
votes
4
answers
38k
views
Minio: Add a public bucket with docker-compose
Below is a service in my docker compose.
minio:
image: minio/minio:edge
environment:
MINIO_ACCESS_KEY: minio123
MINIO_SECRET_KEY: minio123
volumes:
- datastore:/data
...
8
votes
2
answers
14k
views
Is there a way to stream data directly from python request to minio bucket
I am trying to make a GET request to a server to retrieve a tiff image. I then want to stream it directly to MinIO using the put_object method in the MinIO python SDK.
I know I could do this by ...
4
votes
2
answers
1k
views
Minio in docker cluster is not reachable from spark container
I have created network
docker network create app-tier --driver bridge
and used this docker compose file
networks:
default:
external:
name: app-tier
services:
minio:
image: '...
27
votes
2
answers
49k
views
Minio: How's bucket policy related to anonymous/authorized access?
Minio has policies for each bucket. Which contains:
ReadOnly
WriteOnly
Read+Write
None
How are these related to the anonymous/authorized access to the folders?
Like say I want to make a bunch of ...
14
votes
6
answers
20k
views
Minio console not accessible behind nginx reverse proxy
I am trying to redirect a example.com/minio location to minio console, which is run behind a nginx proxy both run by a docker compose file. My problem is that, when I'm trying to reverse proxy the ...
9
votes
1
answer
5k
views
Minio with Nginx and presigned URL
Is it possible do run MinIO not on default path on nginx?
I have a backend that generate presigned url with this code:
MinioClient minioClient = new MinioClient("http://x.x.x.x:9000", "...
8
votes
5
answers
15k
views
AWS SDK S3 node.js connect to local MinIO server
I have application server written in Node.js which upload files to AWS S3 storage. For that I'm using https://www.npmjs.com/package/aws-sdk and when I'm connecting to and uploading to my AWS ...
5
votes
2
answers
6k
views
S3UploadFailedError due to MissingContentLength when calling PutObject in MLflow using MinIO
When trying to save / upload a file using mlflow.log_artifact() to MinIO, our MLflow users are suddenly getting this error in previously working code, raised in boto3 package (used by the mlflow ...
4
votes
1
answer
1k
views
NoClassDefFoundError raised when reading Minio data using PySpark
I've tried installing different versions of Spark and of the required jar files, but had no success. I'm using a Macbook Air M1.
How to replicate
Run a Minio instance locally at port 9000.
Dockerfile:
...
3
votes
3
answers
14k
views
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1108)
I'm trying to run a simple python script to access s3 buckets in minio server in WINDOWS. The server is using self signed certificate. There's an error in SSL handshake. I have tried all possible ways ...
3
votes
1
answer
12k
views
Minio install behind Traefik
I had the previous version (from last yr) of minio running well behind traefik and on portainer with no issues. I attempted an upgrade 4 days ago to the new version and it's been downhill since then. ...
2
votes
1
answer
3k
views
How to override endpoint in AWS-SDK-CPP to connect to minio server at localhost:9000
I tried something like:
Aws::Client::ClientConfiguration config;
config.endpointOverride = Aws::String("localhost:9000");
It does not work.
It seems that AWS-SDK-CPP by default uses virtual hosting:
...
2
votes
1
answer
4k
views
Failed to load object with presigned url Minio Python
i'm using Minio Server to handle files in my Flask API. I generate Presigned Url to upload images directly from Angular FrontEnd to save Backend resources.
Presign Url Generation works fine but when ...
2
votes
1
answer
914
views
kafka connect s3 source not working with Minio
I have verified the connection to minio, making sure that the credentials are working fine and minio is reachable. Also if I try any other value for store.url = http://minio:9000 I am not able to save ...
2
votes
1
answer
4k
views
Missing fields in request to upload files to minio using the generated presigned url
I'm using Minio Server to handle files in my nodejs API, basically to emulate s3 locally. I generated Presigned Url to upload images directly.
Presign Url Generation works fine but when I upload my ...
1
vote
1
answer
3k
views
k8s, Ingress, Minio, and a Static Site
We have a k8s cluster with an nginx Ingress and Minio installed. In Minio I have a bucket called tester with a hello world index.html file. I used the Minio MC client to set the tester bucket to ...
1
vote
1
answer
4k
views
Upload to Minio directly from Flask service
I want to store a file from a Flask service to a Minio Bucket without storing it in a directory first. What I can do so far is have the user upload a file using a Flask service, store it in a ...
0
votes
1
answer
292
views
Limit upload speed on c#
Im building an app to upload clips auto to a Minio S3 server.
When im playing and save a clip, the app uses 100% of bandwidth and this is so annoying.
I need to limit the upload speed to complete this,...
0
votes
1
answer
682
views
Which s3 policy types are supported in MINIO?
I am investigating minio. For now I have docker-compose with minio service and minio console is available for me. As I understand minio is kinda replacement for amazon s3.
I've found the following ...
0
votes
1
answer
810
views
Spark history server with minIO: getting AmazonHttpClient: Unable to execute HTTP request: Connection refused
I am trying to run Spark History Server with minIO but keep getting
AmazonHttpClient: Unable to execute HTTP request: Connection refused
Complete exception:
20/10/20 09:06:21 INFO AmazonHttpClient: ...
0
votes
1
answer
1k
views
Spark on Kubernetes with Minio - Postgres -> Minio -unable to create executor due to
Hi I am facing an error with providing dependency jars for spark-submit in kubernetes.
/usr/middleware/spark-3.1.1-bin-hadoop3.2/bin/spark-submit --master k8s://https://112.23.123.23:6443 --deploy-...