1,003 questions
0
votes
1
answer
558
views
Connecting to Delta Lake hosted on MinIO from Dask
I'm trying to connect to a DeltaLake table that is stored on MinIO rather than S3. I can do this directly with the deltalake Python package as follows:
storage_options = {
"AWS_ENDPOINT_URL&...
- 1,258
1
vote
1
answer
901
views
Dockerized MinIO Presigned URL SignatureDoesNotMatch with Flask
I have a dockerized Flask + MinIO application.
When creating the MinIO client with Flask, I use the Docker alias "minio". If I use "localhost:9000", it will fail to connect.
...
- 35
2
votes
0
answers
334
views
What is a MinIO Access key and how does it work?
I have read the documentation, asked GPT and also read the corresponding mc command doc and I don't get what a Access Key is.
It doesn't help that the documentation uses access key also as username (...
- 10.6k
1
vote
0
answers
51
views
Uploaded images on S3 by using Deeplake Library, does not correspond with the originals
My question is about uploading an image file to s3 (minio). After I upload jpeg or tif file on s3, I attempt to download these images but these are different when I compare with the original images. ...
- 11
2
votes
0
answers
330
views
Minio and a NodeJS API in a docker-compose project: how to handle presigned URLs?
I am working on a Webapp, that contains a Backend and a Frontend (both in NodeJS, the first using Express and the second using Next.JS), in addition to a MariaDB and a Minio services.
I want to be ...
1
vote
1
answer
968
views
AWS Java SDK 2 (putObject) + MinIO: The authorization mechanism you have provided is not supported. Please use AWS4-HMAC-SHA256
I have run MinIO in a docker container, created a bucket (test), made the bucket as public, created access key, set a server location (us-east-1).
After that I build a client:
final S3Client client = ...
- 1,656
0
votes
1
answer
629
views
Airflow connection error with Minio bucket
I'm trying to set up an airflow DAG triggered by file uploads to a Minio bucket. However, I'm stuck on configuring the connection in airflow. After providing these information, I ran a test and got ...
- 29
0
votes
1
answer
2k
views
S3 Minio: An error occurred (400) when calling the HeadBucket operation: Bad Request"}
I am trying to run S3 environment locally
I created docker-compose dile
services:
# docker-compose up is not working on MacOS because of EFK services
s3:
image: minio/minio
command: ...
- 1,718
0
votes
1
answer
766
views
I have problem uploading files to minio bucket using python app
Problem Description:
I'm encountering an issue with file uploads to MinIO using Python code. When I upload files with the the Python script, the uploaded files appear in the MinIO bucket but have no ...
0
votes
1
answer
74
views
Minio S3 upload .jpg file to bucket
I need to create S3 bucket and upload .jpg files to created bucket.
public void saveTest(){
try {
MinioClient minioClient = MinioClient.builder()
.endpoint("http://...
- 15
0
votes
1
answer
248
views
Python: Creating Zip file from Minio objects results in duplicate entries for each file
In my application, I need to get files from Minio storage and create a Zip-file from them. Some files might be really large so I'm trying to write them in chunks to be able handle the process more ...
- 379
0
votes
0
answers
73
views
Can I use Terraform to apply the same configuration locally as in the Cloud?
I'm new to Terraform, so apologies if I'm misunderstanding the use case.
I'm developing a system which uses Ruby on Rails, PostgreSQL and S3. Locally each of those things runs as a docker container, ...
- 69
2
votes
1
answer
1k
views
How can I delete all versions of an object in a versioning-enabled minio bucket using java SDK?
I could not find any parameter for deleting all versions of an object using Minio java SDK. For example, the following code only marks an object as deleted, but it does not really delete the object ...
- 4,972
0
votes
1
answer
807
views
How to create empty folder/object in Minio using C#
I am using MinIO Client
I am doing a pet-project for cloud storage. I want to create a new empty folder in an existing bucket. How do i do this?
I have already tried doing it this way:
public ...
- 1
1
vote
0
answers
84
views
Does the amount of subfolders and files inside a bucket / folder slow down min.io?
I am planning a minio folder structure. The idea is to have the files inside of the 4th subfolder (5th folder), like this:
bucket
- folder 1
- subfolder 1
- subfolder 2
- subfolder 3
...
- 59
4
votes
2
answers
5k
views
Cannot login to minio behind nginx proxy
I cannot login to minio console behind nginx proxy. Both are started as docker container with docker compose. I can login to minio without proxy by accessing localhost:9001, but I cannot when behind ...
- 2,085
1
vote
0
answers
649
views
I'm trying to upload an image with a signed URL in react minio, 403 error with CORS
I am using react.
I am using minio with docker-compose.
minio:.
image: "quay.io/minio/minio"
volumes:.
- . /.data/minio/data:/export
- . /.data/minio/config:/root/....
- 11
2
votes
1
answer
2k
views
Files not showing up on MinIO console
I am running two Docker containers from the following docker-compose.yml file:
version: '3'
services:
minio:
image: minio/minio:latest
ports:
- 9000:9000
- 9001:9001
volumes:...
- 41
1
vote
1
answer
232
views
Difficulty accessing Minikube-deployed MinIO service from a different machine
I have set up Minikube in a VM (ubuntu OS) and deployed MinIO using the following YAML file:
# Deploys a new Namespace for the MinIO Pod
apiVersion: v1
kind: Namespace
metadata:
name: minio-dev
...
- 21
0
votes
1
answer
137
views
Firebase and minio integration [closed]
I am interested in the following. Please tell me, is it possible to configure Firebase in such a way that it automatically uploads documents to Minio. Or is this something that needs to be handled at ...
0
votes
1
answer
1k
views
I'm using AWS DataSync from on-premise to Amazon S3, If I delete the data in on-premise, will it sync to Amazon S3?
Does AWS DataSync sync the file that has been deleted in on-premise to Amazon S3, so from both location it is gone/deleted? If yes, can I turn off this feature? How?
I've read the documentation for ...
0
votes
0
answers
489
views
Failed to resolve 'minio' ([Errno -2] Name or service not known)")) in django project
Hello I'm trying to start Minio using docker, but i get this error:
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='minio', port=9000): Max retries exceeded with url: /local-static?...
- 369
0
votes
1
answer
874
views
How to upgrade a Helm chart or image version of an application deployment in kubernetes without losing data in associated PV?
I am attempting to update a MinIO deployment in my Kubernetes cluster, and I am having some trouble in keeping access to any data that was uploaded to the MinIO deployment before upgrading the Helm ...
- 760
0
votes
0
answers
123
views
Copy list of objects across buckets while keeping object prefixes intact
ℹ︎ This question is about the MinIO Client, not the MinIO Server object storage!
I have two S3-compatible buckets A and B, and I need to copy a list of objects from A to B. The catch is that
I do ...
- 549k
1
vote
1
answer
2k
views
Nginx reverse proxy for minio presigned url throwing SignatureDoesNotMatch error
minio is running on url: abc.example.com:9000
For application we have xyz.example.com,
I want to reverse proxy the minio presigned URL with application url (xyzminio.example.com/presigned_url).
server ...
- 653