Minio: Unable to create an object

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

• Label this issue
• Close this issue

Hello

I hope some can help me

we have

Gitlab Enterprise Edition 14.10.5

It deployed as Chart in our Kubernetes version v1.21.10

Sometimes we faced a problem by minio, when some of our pipeline try to upload artifact into minio. The pipeline had been worked normally before on Gitlab Server and we never had this problem.

the Error Log is :

`time="2022-07-12T10:01:36Z" level=error msg="Unable to create an object. /gitlab-packages/tmp/uploads/1657620096-33-0055-7837-69c14042c3caec25613fe445f408b99f" 
cause="mkdir /export/.minio.sys/buckets/gitlab-packages/tmp/uploads: no such file or directory" 
source="[object-handlers.go:621:objectAPIHandlers.PutObjectHandler()]" 
stack="/q/.q/sources/gopath/src/github.com/minio/minio/cmd/fs-v1.go:608:fsObjects.PutObject() <autogenerated>:1:(*fsObjects).PutObject() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/object-handlers.go:619:objectAPIHandlers.PutObjectHandler() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/api-router.go:63:(objectAPIHandlers).PutObjectHandler-fm() /opt/go/src/net/http/server.go:1918:HandlerFunc.ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/vendor/github.com/gorilla/mux/mux.go:107:(*Router).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/generic-handlers.go:600:rateLimit.ServeHTTP() <autogenerated>:1:(*rateLimit).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/generic-handlers.go:558:pathValidityHandler.ServeHTTP() <autogenerated>:1:(*pathValidityHandler).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/generic-handlers.go:497:httpStatsHandler.ServeHTTP() <autogenerated>:1:(*httpStatsHandler).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/generic-handlers.go:65:requestSizeLimitHandler.ServeHTTP() <autogenerated>:1:(*requestSizeLimitHandler).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/generic-handlers.go:90:requestHeaderSizeLimitHandler.ServeHTTP() <autogenerated>:1:(*requestHeaderSizeLimitHandler).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/crossdomain-xml-handler.go:51:crossDomainPolicy.ServeHTTP() <autogenerated>:1:(*crossDomainPolicy).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/generic-handlers.go:219:redirectHandler.ServeHTTP() <autogenerated>:1:(*redirectHandler).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/generic-handlers.go:267:minioReservedBucketHandler.ServeHTTP() <autogenerated>:1:(*minioReservedBucketHandler).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/generic-handlers.go:246:cacheControlHandler.ServeHTTP() <autogenerated>:1:(*cacheControlHandler).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/generic-handlers.go:337:timeValidityHandler.ServeHTTP() <autogenerated>:1:(*timeValidityHandler).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/vendor/github.com/rs/cors/cors.go:190:(*Cors).Handler.func1() /opt/go/src/net/http/server.go:1918:HandlerFunc.ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/generic-handlers.go:448:resourceHandler.ServeHTTP() <autogenerated>:1:(*resourceHandler).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/auth-handler.go:234:authHandler.ServeHTTP() <autogenerated>:1:(*authHandler).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/cmd/generic-handlers.go:133:reservedMetadataHandler.ServeHTTP() <autogenerated>:1:(*reservedMetadataHandler).ServeHTTP() 
/q/.q/sources/gopath/src/github.com/minio/minio/pkg/http/server.go:107:(*Server).Start.func1() /opt/go/src/net/http/server.go:1918:HandlerFunc.ServeHTTP() /opt/go/src/net/http/server.go:2619:serverHandler.ServeHTTP() /opt/go/src/net/http/server.go:1801:(*conn).serve()"
`

I noticed that Gitlab still use the an old Image from minio "RELEASE.2017-12-28T01-21-00Z". So I tested with the new Image from minio "RELEASE.2022-07-24T17-09-31Z" but that not help me at all

the Error Log is :

API: PutObject(bucket=gitlab-packages, object=tmp/uploads/1657636688-33-0424-1954-baf7e0b63480fbdb977e5665c24d1c36)
Time: 14:38:08 UTC 07/12/2022
DeploymentID: 1e756707-f63d-4a46-9fde-7deadb4878e6
RequestID: 17011BC92F21313D
RemoteHost: 10.42.4.15
Host: gitlab-minio:9000
UserAgent: Go-http-client/1.1
Error: file not found (cmd.StorageErr)
       6: internal/logger/logger.go:270:logger.LogIf()
       5: cmd/fs-v1-helpers.go:360:cmd.fsRenameFile()
       4: cmd/fs-v1.go:1133:cmd.(*FSObjects).putObject()
       3: cmd/fs-v1.go:1038:cmd.(*FSObjects).PutObject()
       2: cmd/object-handlers.go:1832:cmd.objectAPIHandlers.PutObjectHandler()
       1: net/http/server.go:2084:http.HandlerFunc.ServeHTTP()

API: PutObject(bucket=gitlab-packages, object=tmp/uploads/1657636785-35-0530-7328-392e51c2b8c4bc80de1d4d36aca5fc05)
Time: 14:39:45 UTC 07/12/2022
DeploymentID: 1e756707-f63d-4a46-9fde-7deadb4878e6
RequestID: 17011BDFAFE6E00A
RemoteHost: 10.42.5.202
Host: gitlab-minio:9000
UserAgent: Go-http-client/1.1
Error: file not found (cmd.StorageErr)
       6: internal/logger/logger.go:270:logger.LogIf()
       5: cmd/fs-v1-helpers.go:360:cmd.fsRenameFile()
       4: cmd/fs-v1.go:1133:cmd.(*FSObjects).putObject()
       3: cmd/fs-v1.go:1038:cmd.(*FSObjects).PutObject()
       2: cmd/object-handlers.go:1832:cmd.objectAPIHandlers.PutObjectHandler()
       1: net/http/server.go:2084:http.HandlerFunc.ServeHTTP()

I tried to create the path manually, but minio delete it every times

thank you and Best Regards