Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • Jan 30 16:19

    andyHa on 12.4.1

    (compare)

  • Jan 30 16:19

    andyHa on master

    Delays the creation of a part i… Merge pull request #179 from sc… (compare)

  • Jan 30 16:19
    andyHa closed #179
  • Jan 29 13:17
    andyHa opened #179
  • Jan 29 13:17

    andyHa on InstantiationFixx

    Delays the creation of a part i… (compare)

  • Jan 25 15:56

    andyHa on 12.4

    (compare)

  • Jan 25 15:48

    sabieber on KeepRunning

    (compare)

  • Jan 25 15:48

    sabieber on master

    Adds a flag which lets all dock… Merge pull request #178 from sc… (compare)

  • Jan 25 15:48
    sabieber closed #178
  • Jan 25 15:34
    andyHa opened #178
  • Jan 25 15:34

    andyHa on KeepRunning

    Adds a flag which lets all dock… (compare)

  • Jan 25 13:42

    Tobsucht on FastBackgroundLoops

    (compare)

  • Jan 25 13:42

    Tobsucht on master

    Reduces the default wait interv… Merge pull request #177 from sc… (compare)

  • Jan 25 13:42
    Tobsucht closed #177
  • Jan 25 13:18
    andyHa opened #177
  • Jan 25 13:18

    andyHa on FastBackgroundLoops

    Reduces the default wait interv… (compare)

  • Jan 22 08:30

    andyHa on rm

    (compare)

  • Jan 22 08:30

    andyHa on 12.3

    (compare)

  • Jan 22 08:06

    andyHa on master

    Performs refactroings suggested… Simplifies array handling. Simplifies a convoluted block o… and 4 more (compare)

  • Jan 22 08:06
    andyHa closed #176
Andreas Haufler
@andyHa
our keep it running on a machine and delete everything every once in a while
Lokesh Chandra
@Lokeshima_twitter
Well I am trying to test when writing on s3 if it fails due to any reason then my code should do automatic retry using the aws automatic retry option.
The code is already implemented but I am unable to test it. Can you please how can integrate it with my code?
Andreas Haufler
@andyHa
s3ninja cannot simulate failures currently
this would / could be achieved using a mocking framework
you could mock the aws libraries and thrown an artificial exception
and check of the expected recovery
Lokesh Chandra
@Lokeshima_twitter
ok can you give me the relevant link for the same
if you have it handy
Andreas Haufler
@andyHa
try googleing for „spock framework“ which is what we use in s3ninja and sirius-kernel and the like
or generally „mocking in unittests"
there are plenty of libraries to help you
Lokesh Chandra
@Lokeshima_twitter
ok sure and many thanks for helping me out
Andreas Haufler
@andyHa
no worries
draim
@draim
Hi!
To start with, I'd like to say that S3Ninja is a great project! After struggling a while I was able to connect from a C# .NET Core project to S3Ninja locally. However, when I try to PUT an object I get HTTP 403 back. Do you have any idea of why this happens? Error messsage goes like this:
"Amazon.S3.AmazonS3Exception: Error making request with Error Code Unauthorized and Http Status Code Unauthorized. No further error information was returned by the service." (followed by a pretty long AWS SDK + Microsoft Kestrel/IIS stack trace I guess you're not interested in)
I've browsed the source code for S3Ninja and I can't see that a HTTP 403 is returned anywhere in S3Controller.java.
The Access Log shows my request with the Result column specifying "REJECTED" and some time taken.
I did set the accesskey and secretkey specifically in the config file and this is reflected when browsing http://localhost:9444.
I'm also sure I use these matching credentials when connecting, also setting ForcePathStyle = true together with UseHttp = true in the config section for the client.
Any help appreciated!
Andreas Haufler
@andyHa
hi
2 possible things...
1) there are actually many AWS SDKs with different auth schemes
(aws switched the hash computation several times and I’m not 100% if we support them all)
do you know your version?
other problem might be a wrong base URL
draim
@draim
Thanks for such a quick answer. Will check version.
Andreas Haufler
@andyHa
as we need to access http://localhost:9444/s3 not http://localhost:9444 itself
but if there is a failed request in the API log, there is a good chance that the version is „wrong"
draim
@draim
Ok, for C# there are different SDK modules for each of the Amazon services, so my "AWSSDK.S3" has version "3.3.5.10".
Andreas Haufler
@andyHa
in java we successfully use 1.11.82 - no idea if the versions match with .net
hm, sounds quite different^^
draim
@draim
Seems we are comparing apples and pears here... :)
Andreas Haufler
@andyHa
is there a ClientConfiguration
and does this support something like .withSignerOverride("S3SignerType")
draim
@draim
There's a AmazonS3Config... I'll check the properties.
Andreas Haufler
@andyHa
this is what we use to ensure we use a signer which is supported by both, AWS and CEPH and s3ninja
k
draim
@draim
There's a SignatureMethod that can be set to either SigningAlgorithm.HmacSHA1 or SigningAlgorithm.HmacSHA256.
Andreas Haufler
@andyHa
could you try the former?
draim
@draim
There's also a SignatureVersion that can be set to any string.
Andreas Haufler
@andyHa
ah
thats the one
try „S3SignerType“ that works for Java^^
draim
@draim
Haha, I'll try that... :)
Sorry, that didn't work. I tried without specifying SignatureMethod and also setting it to the two beforementioned variants. Perhaps I should fork your repo and port it to C#? :)
Andreas Haufler
@andyHa
haha - would be enough to implement the new hash method in java^^
you could also file an issue in GH for s3ninja
sooner or later we need to update that anyway
draim
@draim
Sure, I can file an issue in GH. I'll simply sum up what I've got so far, more or less what is written here.
Thanks for the help anyway!
Andreas Haufler
@andyHa
no worries
Chad Birch
@chadbirch

I'm having some issues setting Content-Length in a HEAD response from S3Ninja. In the S3Controller, I add the following line to the response in S3Controller.java/GetObject:541:

response.addHeader(HttpHeaderNames.CONTENT_LENGTH, object.getFile().length());

I added some console logging for verification. When I rebuild and execute a HEAD request, the console reports the correct 'content-length', but my response header has 'content-length -> 0'. I'm using Postman. This is occurring before:

response.status(HttpResponseStatus.OK);

So it should be added to the response before it is complete. Any ideas what happening? Is it getting reset somewhere?

Zakaria Amine
@zak905
Hello everybody, I am having an issue with S3 Ninja. I extended the AWS SDK client, and tweaked so that it uploads to my S3 server
*S3 ninja
The problem is that I receive images in binary format, so they are not recognized by the computer as valid Jpeg