1,003 questions
-2
votes
0
answers
59
views
minio signature does not match golang api [closed]
I encountered a SignatureDoesNotMatch issue when switching MinIO from Docker Run to Docker Compose. I'm using PresignedUploadURLs to upload files from the frontend (React/Axios).
I've tried all the ...
0
votes
1
answer
130
views
AWSSDK.S3 causes x-amz-content-sha256 error against minio
I'm using the AWSSDK.S3 for .NET (v4.0.9.1) in my app. For my tests I run minio in a docker container. I know this worked in the past but with an update to the current versions of the SDK and the ...
- 6,718
2
votes
1
answer
55
views
What is the best way to check the file size in S3 multipart upload?
I would like to set a file size limit in uploads through multipart upload in my application, but my problem is, using pre-signed-url, I can't check the file size of each part and all the options I ...
- 21
0
votes
1
answer
133
views
Unable to Create Tables in Iceberg via Trino with MinIO and Iceberg REST Catalog
I'm setting up a data lake using the following stack, using docker compose.
MinIO + IceBerg Rest + Trino + Superset.
docker-compose.yml
version: "3.9"
services:
# ---------------- MinIO --...
- 3,735
0
votes
0
answers
120
views
Setting default access/secret token in minio through docker
I spent all afternoon with ChatGPT and couldn't figure this out. Using Minio in a Docker Stack for local development, everything works fine. Would love to, though, start it up with:
a default ...
- 11.7k
3
votes
1
answer
295
views
Upload a large file to Minio from Minio objects
I have the next case:
Get a certain count of N objects from Minio and create zip archive and upload it zip to Minio as one object.
Problem:
I have many objects, that are up to 40gb in size
I can't ...
- 345
0
votes
0
answers
46
views
MinIO: Credentials returned by AssumeRoleWithCustomToken don't work
I have created an identity plugin for MinIO as per the documentation.
I have manually verified that if I now send an [AssumeRoleWithCustomToken] (https://min.io/docs/minio/linux/developers/security-...
- 3,252
0
votes
0
answers
54
views
PyFlink MiniCluster “Could not find a file system implementation for scheme ‘s3a’” when writing filesystem sink to S3/MinIO
I’m running PyFlink 1.19.1 inside a Jupyter notebook on a local MiniCluster and trying to write a filesystem sink to an S3-compatible MinIO endpoint. When I submit the same job (same JARs, same ...
- 33
0
votes
1
answer
240
views
MinIO webhook event notification config doesn't see provided auth_token
I wanted to use MinIO Webhook Service Notification. The logic I want to have is, when some file is uploaded to bucket1 with prefix "all/", MinIO should send event notification to provided ...
- 11
0
votes
0
answers
44
views
MinIO External Access Management Plugin traffic reduction
I am working on a MinIO cluster that receives around 20k RPS.
I am using a custom authorization service, which is essentially a proxy, that contains all the authorisation logic.
If a request is marked ...
- 603
0
votes
0
answers
29
views
Is there a way to cancel/abort Flet.FilePicker.update() when use it with Minio/s3 presigned url for web app?
i'm a newbie to Flet and i can't solve this problem. After the command:
file_picker.upload([FilePickerUploadFile(name=filename,upload_url=presigned_url)])
Object from userside' files start to be ...
- 41
2
votes
1
answer
839
views
Docker compose with MinIO `entrypoint` raises `config is not a recognized command`
I was using the following service definition in a docker compose file without problems,
to create a MinIO bucket.
createbucket:
image: minio/mc:latest
networks:
- main-network
entrypoint: &...
- 271
2
votes
1
answer
104
views
How to stream a large file on Kubernetes pod
I want to create a large file(>200GB) and store it in Min.IO store. I deploy my attempts in a web app on a Kubernetes pod.
One attempt was with a modified Redeable stream and csv-writter library ...
0
votes
0
answers
56
views
Minio Access denied with liferay
Facing an error while uploading large images with a size over 20MB through Liferay, it gives me
2025-05-11 11:47:28.861 INFO [pool-7-thread-1][UploadCallable:284] Unable to abort multipart upload, ...
0
votes
0
answers
69
views
How to load CSV data from a Data Lake into a Nessie table
I’m currently using the following stack: MinIO + Apache Iceberg + Project Nessie + Dremio. In My MinIO I have two buckets one is datalake bucket and another is warehouse.
Here is image:
In MinIO, I ...
- 5,095
0
votes
0
answers
62
views
How can I manage image usage in MinIO storage when saving as Sha256?
I am building an image and storing it in a MinIO storage mounted on NFS.
Each image is stored in a folder created using a unique sha256 hash when it is created.
The problem is that the image is ...
- 1
1
vote
0
answers
125
views
Django downloads binary file from FastAPI (MinIO presigned URL), but the file is corrupted and downloaded with wrong name
I'm using Django (frontend) and FastAPI (backend) with MinIO as file storage. My setup:
FastAPI generates a presigned MinIO download_url for the file.
Django fetches metadata via FastAPI, then ...
- 73
0
votes
0
answers
132
views
Assistance Required: Resolving S3AFileSystem ClassNotFoundException in Trino
We are trying to setup trino with minIO and have encountered a persistent issue with our Trino configuration. Below is a detailed overview of our setup, the error we are facing, and the steps we have ...
0
votes
0
answers
80
views
Connection error when retrieve files on S3 disk (MinIO) using HTTPS domain
Issue description
I'm having a connection error when I trying to connect to a MinIO (S3) server over HTTPS, It just happens with HTTPS (using a domain name) because when I use HTTP (with IP address) ...
1
vote
0
answers
153
views
minio performance issues with increased number of drives
We are considering minio as a binary storage for our needs. During testing, we came across unexpected (for us) behavior. Here it is:
Our setup:
3x Ubuntu 22.04 servers, 32 CPUs, 192G RAM, 4x NVMe on ...
1
vote
0
answers
55
views
minio object Transforms with Object Lambda The security token included in the request is invalid
I want to use MinIO Object Transforms, but I got an error when trying to download a presigned URL. I followed their documentation exactly, as shown in this link.
I also watched this video and ...
0
votes
0
answers
37
views
NotImplementedError when testing S3 connection during __init__ in s3fs.S3FileSystem subclass
I'm creating a subclass of s3fs.S3FileSystem that connects to either AWS S3 or MinIO based on environment variables. The connection should fail immediately during initialization if credentials are ...
- 121
0
votes
0
answers
44
views
How can I generate a presigned URL for a specific versionId using MinIO .NET SDK?
How can I generate a presigned URL for a specific versionId using MinIO .NET SDK? What is the recommended approach for including a versionId when generating a presigned URL?
0
votes
0
answers
484
views
Unable to access MinIO Console via browser, but curl works fine. Also, "no route to host" error with script unless using sudo
I'm facing a strange issue where I can successfully access the MinIO Console using curl and nc on port 9001 from my MacBook, but when trying to open the same address in a browser, the page doesn't ...
- 3
0
votes
1
answer
76
views
Generate a token using Python requests vs mc binary?
I am using Python MinIO SDK, but there are admin operations that it cannot do, and then we use the mc binary instead.
But the binary has all these files on disk that we can't have in our ENV so we ...
- 8,199