1,003 questions
-2
votes
0
answers
59
views
minio signature does not match golang api [closed]
I encountered a SignatureDoesNotMatch issue when switching MinIO from Docker Run to Docker Compose. I'm using PresignedUploadURLs to upload files from the frontend (React/Axios).
I've tried all the ...
- 1,089
0
votes
1
answer
89
views
contextlib tries to change a "frozen" exception
I got a strange error in my pytest after some Dependabot updates.
In my case it's triggered by an non-existent MinIO bucket exception.
None of the updates made by Dependabot were in MinIO or Python (...
- 1,722
5
votes
3
answers
19k
views
Download entire directory in a bucket of MinIO
Here is my MinIO tree
bucket1
|
|-dir1
|-dir2
|-file1
|-file2
|-file3
I want to download the entire directory "dir2" using python API.
The only way I can think of is to download files ...
- 17.5k
0
votes
3
answers
2k
views
Proper way to create a duckdb table from a minio s3 bucket?
I ran minio as a docker container using the latest image from https://hub.docker.com/r/minio/minio:
docker run
-d
-p 9000:9000
-p 9001:9001
-v C:\\Users\\drew\\Downloads\\NY:/data
minio/minio ...
- 1,040
2
votes
1
answer
55
views
What is the best way to check the file size in S3 multipart upload?
I would like to set a file size limit in uploads through multipart upload in my application, but my problem is, using pre-signed-url, I can't check the file size of each part and all the options I ...
- 3,652
6
votes
4
answers
9k
views
How can I change bucket name in MinIO?
We have a Minio cluster that we use as an on-premises object storage. We want to rename a bucket in it. How can I do this?
- 551
3
votes
1
answer
10k
views
Why am I getting error creating object in Minio?
I'm trying to create an object in Minio. Sometimes it works and sometimes no.
When I execute :
minioClient.makeBucket(bucketName); // bucketName es a random unique string
I don´t get error, but if If ...
CommunityBot
- 1
0
votes
1
answer
133
views
Unable to Create Tables in Iceberg via Trino with MinIO and Iceberg REST Catalog
I'm setting up a data lake using the following stack, using docker compose.
MinIO + IceBerg Rest + Trino + Superset.
docker-compose.yml
version: "3.9"
services:
# ---------------- MinIO --...
0
votes
1
answer
3k
views
Laravel Minio Temporary URL
I'm looking for a hacky way to create temporary URLs with Minio
I see on the Laravel docs it says: Generating temporary storage URLs via the temporaryUrl method is not supported when using MinIO.
...
- 2,046
7
votes
3
answers
7k
views
Downloading a file from MinIO S3 storage in ASP.NET
I am trying to download a file from minio using official Minio package.
The way I managed to download a file seems pretty incorrect to me:
var downloadStream = new MemoryStream();
var args = new ...
3
votes
1
answer
295
views
Upload a large file to Minio from Minio objects
I have the next case:
Get a certain count of N objects from Minio and create zip archive and upload it zip to Minio as one object.
Problem:
I have many objects, that are up to 40gb in size
I can't ...
- 33
5
votes
1
answer
907
views
Laravel + Minio s3 = AWS HTTP error: cURL error 56: Recv failure: Connection reset by peer
recently I updated my PHP to PHP 8.2.6. It was 8.0
Now I was testing Minio on my Laravel APP, when I tried to get a s3 object I'm getting this error:
Error executing "ListObjectsV2" on
&...
- 153
0
votes
0
answers
46
views
MinIO: Credentials returned by AssumeRoleWithCustomToken don't work
I have created an identity plugin for MinIO as per the documentation.
I have manually verified that if I now send an [AssumeRoleWithCustomToken] (https://min.io/docs/minio/linux/developers/security-...
- 3,252
0
votes
0
answers
54
views
PyFlink MiniCluster “Could not find a file system implementation for scheme ‘s3a’” when writing filesystem sink to S3/MinIO
I’m running PyFlink 1.19.1 inside a Jupyter notebook on a local MiniCluster and trying to write a filesystem sink to an S3-compatible MinIO endpoint. When I submit the same job (same JARs, same ...
- 33
0
votes
0
answers
128
views
MinIO in Kubernetes fails with "Rename across devices" error when using PersistentVolumeClaim (works with hostPath)
I'm setting up MinIO and MLflow in a Minikube Kubernetes cluster and encountering persistent volume issues. The deployment works correctly when using hostPath, but fails with a "Rename across ...
- 11
0
votes
0
answers
100
views
How can I implement Get Bucket Quota for Minio in Python
I have been pulling my hair out trying to implement an equivalent for this mc cli command in Python.
[me@kompir ~/src/mc]$ mc quota info localhost-reporting-api/bucket-99
Bucket `bucket-99` has hard ...
9
votes
2
answers
22k
views
How to authenticate in REST request to MinIO [closed]
I am experimenting with MinIO. I try to send REST API calls directly to MinIO port 9000. So far, I understood that authentication works the same as the Amazon S3 API authentication works - correct? ...
- 133
0
votes
0
answers
44
views
MinIO External Access Management Plugin traffic reduction
I am working on a MinIO cluster that receives around 20k RPS.
I am using a custom authorization service, which is essentially a proxy, that contains all the authorisation logic.
If a request is marked ...
- 603
0
votes
1
answer
155
views
Download folder (or list of file) with large file (500MB) and build zip with laravel and minio
I'm trying to download a folder by calling my controller in Laravel.
However, I'm running into a "memory exceeded" issue because one of the files I'm downloading is around 500MB.
Currently, ...
0
votes
0
answers
29
views
Is there a way to cancel/abort Flet.FilePicker.update() when use it with Minio/s3 presigned url for web app?
i'm a newbie to Flet and i can't solve this problem. After the command:
file_picker.upload([FilePickerUploadFile(name=filename,upload_url=presigned_url)])
Object from userside' files start to be ...
- 41
0
votes
0
answers
144
views
Cannot access iceberg table metadata on S3 compatible "MINIO" server from Nessie
I can write and read aniceberg successfully using pyspark, Nessie and MINIO:
#!/usr/bin/python3.9
from pyspark.sql import SparkSession
iceberg_spark_jar = '/AKE/iceberg-spark-runtime-3.5_2.12-1.9.0....
3
votes
2
answers
1k
views
Retrieving object metadata while traversing S3 using Minio client's list_objects method
I am using the list_objects method of the python minio client and trying to retrieve the metadata for each object while traversing folders in S3. I attempted to do this by setting the ...
- 1,139
0
votes
2
answers
5k
views
How to download the folder from minio as zip file?
The steps I followed are.
get all objects from recursive objects
Iterable<Result<Item>> results = minioClient.listObjects(ListObjectsArgs.builder()
.bucket(bucketName).recursive(true)...
- 121
21
votes
4
answers
38k
views
Minio: Add a public bucket with docker-compose
Below is a service in my docker compose.
minio:
image: minio/minio:edge
environment:
MINIO_ACCESS_KEY: minio123
MINIO_SECRET_KEY: minio123
volumes:
- datastore:/data
...
- 1,254
0
votes
1
answer
83
views
Make Min.IO on Kubernetes to send correct presigned URL to object lambda on knative
I'm having this trouble: I have a minio instance on kubernetes with my minio-dev.example.io dominio, I also have my object lambda to transform some files but this one is on Knative pod: http://object-...
- 3,471