minio/minio

We moved to https://slack.minio.io - please find us there.

vadlamudi tejaswini

@vtejaswini_twitter

Hi, I have a use case to store gzip files in my MinIO server. I have CLI commands supporting such a feature. I'm not sure how to address this using S3 API logic. Does anyone have an idea on how to implement it? Can I directly store gzipped files on the fly in MinIO without needing intermediate storage?

Is there any good go package or minio API that aid this UC?

pva

@pva

Unable to read 'format.json' from http://node1:9000/data/3: Expected 'storage' API version 'v20', instead found 'v20', please upgrade the servers

Hi, have you found solution?

1 reply

Cyber Peach

@peachwaravich

Sorry, I got a problem on connect to minio , error "The request signature we calculated does not match the signature you provided. Check your key and signing method."

AbserAri

@abserari

mc: <ERROR> Cannot add new Remote target. Unexpected client 'admin' API version found 'v3', expected 'v2', please downgrade the client to older releases.

which client version should have downgrade?

Elyor Latipov

@uzbekdev1

<Code>InvalidArgument</Code>
<Message>Your metadata headers exceed the maximum allowed metadata size.</Message>
<Resource>/avatars/a976f48b-4c12-49ab-8b15-93b2b1b47e0d.png</Resource>
<RequestId/>
<HostId>bd146361-a680-44f5-9251-417a3e5d21a3</HostId>
</Error>

Hello #all,how can I fix this issue?

nee in the PresignedGetObjectAsync metadata isnert content length

Ilya

@squadgazzz

Hey everyone! Is it possible to ping minio db somehow? I run minio with docker and I need to know somehow when it’s started

Sylvain Corlay

@SylvainCorlay

Hey there, first experiments with minio, and I am trying to understand the rc.conf syntax addresses to listen to.

would 0.0.0.0/443 work?

prabhant

@prabhant

Hi, I have one small issue with minio erasure code. I was trying to deploy on two notes and at first, i tried

minio server http://mynode{1...2}.mywebsite.com/export{1...6}

Later I found out that internal IP might be the solution so I tried

minio server http://ipaddress1/export{1...6} http://ipaddress2/export{1...6}

this gave me different errors but the main problem I'm getting right now is this error when I try to execute the first command again:
ERROR Unable to initialize backend: 2nd disk is already being used in another erasure deployment. (Number of disks specified: 12 but the number of disks found in the 2nd disk's format.json: 6)

Any idea how to deal with this situation?

Ghost

@ghost~5fbfef87d73408ce4ff5092d

hello

liubiaomr

@liubiaomr

hello ，The original minio configuration information in the current springboot project will not report an error when running the project, but after I re-built the minio server and replaced it with my own address access secret, I kept reporting the error as follows

LiuZheng

@liuzhengcast

how to solve lots of small files prolem with minio? Each txt file is only 1 kb, but there are hundreds of millions of files in total.

Sachin Mittal

@sjmittal

I am trying to put object and looks like when I debug the request of java client I get:
access denied error to this call:
https://minio.dev.server.io/my-bucket?location=
however when I copy the entire request along with its headers in postman
it works fine

anyway I can check the logs on minio server

Sachin Mittal

@sjmittal

I am using minio version RELEASE.2020-05-01T22-19-14Z deployed via minio operator on k8s (aws eks)
when I try to put object via a java client I get this error:

java.io.IOException: unexpected end of stream on Connection{xxxx.eu-west-2.elb.amazonaws.com:9000, proxy=DIRECT hostAddress=xxxx.eu-west-2.elb.amazonaws.com/x.x.x.x:9000 cipherSuite=none protocol=http/1.1}
        at okhttp3.internal.http1.Http1Codec.readResponseHeaders(Http1Codec.java:208)

Caused by: java.io.EOFException: \n not found: limit=0 content=…
        at okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:236)
        at okhttp3.internal.http1.Http1Codec.readHeaderLine(Http1Codec.java:215)
        at okhttp3.internal.http1.Http1Codec.readResponseHeaders(Http1Codec.java:189)

Sachin Mittal

@sjmittal

I am not sure if this code is responsible for the above issue:

if (method == Method.PUT || method == Method.POST) {
      // Issue #924: disable connection retry for PUT and POST methods. Its safe to do
      // retry for other methods.
      httpClient = this.httpClient.newBuilder().retryOnConnectionFailure(false).build();
    }

Sachin Mittal

@sjmittal

I am have an issue ..
it seems that getObject is returning a closed input stream

InputStream stream = minioClient.getObject(GetObjectArgs.builder().bucket(bucket).object(key).build()) byte[] buffer = new byte[inputStream.available()]; inputStream.read(buffer);

returns
java.io.IOException: closed at okio.RealBufferedSource$1.available(RealBufferedSource.java:447) at java.base/java.io.FilterInputStream.available(FilterInputStream.java:167)

vadlamudi tejaswini

@vtejaswini_twitter

Does MinIO have plans to expose the metrics and API for the users to understand bucket storage capacity and available size?
When using MinIO as a backend, how can we create a budget for different buckets and ensure MinIO is not filling disk space?

Ashish Kumar Sinha

@sinhaashish

Use quota
mc admin bucket quota - manage bucket quota

USAGE:
mc admin bucket quota TARGET [--fifo QUOTA | --hard QUOTA | --clear]

QUOTA
quota accepts human-readable case-insensitive number
suffixes such as "k", "m", "g" and "t" referring to the metric units KB,
MB, GB and TB respectively. Adding an "i" to these prefixes, uses the IEC
units, so that "gi" refers to "gibibyte" or "GiB". A "b" at the end is
also accepted. Without suffixes the unit is bytes.

we have moved to slack , so you can post your questions there

vadlamudi tejaswini

@vtejaswini_twitter

Thanks Ashish :)

Mengu Kagan

@mengu

hi all, anyone here?

Domenico Loiacono

@dloiacono

Hi everybody, is minio a good choice for real-time write and read? in our configuration with 4 nodes we are experiences issue on reading objects just saved

wangzhichao

@wzc570738205

minioClient.putObject(bucketName, "dCMZxkwz2.jpg", inputStream, new PutObjectOptions(inputStream.available(), -1));

i am use 7.0.2 minio

error occurred
ErrorResponse(code = AccessDenied, message = There were headers present in the request which were not signed, bucketName = safety-policing-local, objectName = null, resource = /safety-policing-local, requestId = 16868B140421669D, hostId = b577bdce-c597-4018-92f8-71e768f7e71e)
request={method=GET, url=https://xxx.xxx.com/safety-policing-local?location=, headers=Host: minio.safetypolicing.com
Accept-Encoding: identity
User-Agent: MinIO (x86_64; x86_64) minio-java/dev
x-amz-content-sha256: UNSIGNED-PAYLOAD
x-amz-date: 20210608T073352Z
Authorization: AWS4-HMAC-SHA256 Credential=*REDACTED*/20210608/us-east-1/s3/aws4_request, SignedHeaders=accept-encoding;host;x-amz-content-sha256;x-amz-date, Signature=*REDACTED*
}
response={code=400, headers=Server: marco/2.14
Date: Tue, 08 Jun 2021 07:33:53 GMT
Content-Type: application/xml
Content-Length: 342
Connection: keep-alive
X-Source: C/400
Content-Security-Policy: block-all-mixed-content
X-Xss-Protection: 1; mode=block
X-Amz-Request-Id: 16868B140421669D
Accept-Ranges: bytes
X-Request-Id: 1d7cb7569099d598db89eed80cdf57e3
Via: S.mix-js-czx2-046, T.46.D, V.mix-js-czx2-046, T.69.D, M.ctn-zj-jgh-068

who can help me?very thanks!!

chance2021

@chance2021

Hi, I got an error ".../v1/key/decrypt/app-key : x509: certificate has expired or is not yet valid.." today and I deleted/re-created the key with the same name. Now it shows another error "ciphertext is not authentic" whenever I am trying to download the files which were created by previous key.

Just wondering what I should do in order to be able to download the old files? Any advise will be much appreciated! Thanks

Miguel Costa

@cstmgl:matrix.org

[m]

Hi all, I have a very basic question, is there any place in the docs where I can find the release upgrade guides or some kind of changelog between releases?
I'm trying to update from version 2021-04-06T23-11-00Z to version 2021-07-12T02-44-53Z and my readiness probes and liveness probes in my openshift stopped working so I was wondering what I could be missing, but I did not find information for this in the documentation

rwecho

@rwecho

How to get free size of minio use api ?

I found Prometheus tool? but I do not know how to call it in api. thanks.

sharif08

@sharif08

hi. I have a question regarding Minio. Recently i did minio service installation. my question, Is it Possible to use Persistent Volume Storage as minio Server for existing kubernetes Cluster? if yes where can in find the configuration?. I mean AS example NFS Provision allows as Persistent Volume Storage for Kubernetes.

harish0000

@harish0000

I am using the minioClient 8.3.4, how much partSize to be given in .putObject ?

what's the recommendation from minio ?

Li Linchao

@Cactusinhand

https : //github.com/minio/s3verify this project is 404 Not Found

alinalex1392

@alinalex1392

Hello, another questions regarding policies, I have the following scenario:
I have a piece of code that was setting policy on the bucket using mc client /usr/bin/mc policy set $POLICY myminio/$BUCKET where POLICY is a value from public, none, download, upload, public, now I need to replicate this behavior using the go client but the only methods I have is SetBucketPolicy that is not working with the same values as mc client , can you advise me on the methods that I need on the go client library? (edited)

Muhammad02468

@Muhammad02468

hey all, im facing an issue while accessing my objects via browser

im fed up now. you are requested to please help!!!

<Error>
<Code>SignatureDoesNotMatch</Code>
<Message>The request signature we calculated does not match the signature you provided. Check your key and signing method.</Message>
<Key>xen-sheet-fsd.xlsx</Key>
<BucketName>usman-test1</BucketName>
<Resource>/usman-test1/xen-sheet-fsd.xlsx</Resource>
<RequestId>16D6A6356B76888B</RequestId>
<HostId>77d151bf-5c6d-4081-8edf-c5eab75b41d5</HostId>
<script/>
</Error>

Muhammad02468

@Muhammad02468

anyone?

Iman Namvar

@inamvar

Hey, I'm running Minio and my app (Go Application) both inside docker containers through a docker-compose file. there is no reverse-proxy and I'm connecting to Minio directly from the application. I get error The request signature we calculated does not match the signature you provided. Check your key and signing method.
the Minio image is quay.io/minio/minio:RELEASE.2022-05-04T07-45-27Z. everything works fine when I run my application outside of docker container but I have this issue when i run it in the container. how can I get rid of this error?

Where communities thrive

People

Repo info

Activity