coursier/coursier

Pure Scala Artifact Fetching

anirgit

@anirgit

Hello guys, I have a question on coursier resolution exception that I can't figure out a way around. I am using sbt 1.3.13 with 1.0.3 coursier plugin (not using latest coursier due to sbt/sbt#5040). My default scalaVersion is 2.12, however I am trying to compile one subproject on 2.11 only which depends on a couple of other subprojects that are cross compatible for scala 2.11 and 2.12. So it looks like --
module A (scala 2.11 only) depends on module B (supports both 2.11 and 2.12) and module C (supports both 2.11 and 2.12).
When I try sbt +module A/test:compile, everything works fine.
But when I do sbt +test:compile, I get a dependency resolution exception as --

ObjectEvent(error, TraceEvent(Error, coursier.ResolutionException: Encountered 2 error(s) in dependency resolution:
    com.org:moduleB_2.11:0.1-SNAPSHOT:
        not found:
            /home/org/.ivy2/local/com.org/moduleB_2.11/0.1-SNAPSHOT/ivys/ivy.xml
            https://repo1.maven.org/maven2/com/org/moduleB_2.11/0.1-SNAPSHOT/moduleB_2.11-0.1-SNAPSHOT.pom

com.org:moduleC_2.11:0.1-SNAPSHOT:
        not found:
            /home/org/.ivy2/local/com.org/moduleC_2.11/0.1-SNAPSHOT/ivys/ivy.xml
            https://repo1.maven.org/maven2/com/org/moduleC_2.11/0.1-SNAPSHOT/moduleC_2.11-0.1-SNAPSHOT.pom

So I am a bit baffled here is there any difference in terms of coursier resolution when just the moduleA is compiled vs all subprojects get cross compiled. What am I supposed to interpret out of this?

Tobias Roeser

@lefou

Hi, in mill we got the following issue opened lihaoyi/mill#1099:

Actually, Mill seems to pull dependencies by directly building an URL to the supposed pom. However, this method doesn't work on some repositories like for Spigot dependencies.
Mill should first pull the first maven-metadata.xml (example) at <repoUrl>/<group separated by />/<artifactId>/maven-metadata.xml to retrieve the version's metadata file (example) and get the jar name from it.

Does coursier support maven-metatdata.xml?

I opened a new discussion for that: #1945

Max

@maxstreese

Hi everyone, I got a strange resolution question. Consider the code below:

val module = mod"com.streese.registravka4s::registravka4s-core"
// val module = mod"com.sksamuel.avro4s::avro4s-core"

val res = Resolve()
  .addDependencies(Dependency(module, "latest.release"))
  .addRepositories(MavenRepository("https://packages.confluent.io/maven/"))
  .run()

When I run this for the module that is not commented out (registravka4s) I get the following error:

[error] (run-main-6) coursier.error.ResolutionError$CantDownloadModule: Error downloading com.streese.registravka4s:registravka4s-core_2.13:latest.release
[error]   No latest release version found in file:/home/max/.ivy2/local/com.streese.registravka4s/registravka4s-core_2.13/
[error]   not found: https://repo1.maven.org/maven2/com/streese/registravka4s/registravka4s-core_2.13/maven-metadata.xml
[error]   not found: https://packages.confluent.io/maven/com/streese/registravka4s/registravka4s-core_2.13/maven-metadata.xml
[error] coursier.error.ResolutionError$CantDownloadModule: Error downloading com.streese.registravka4s:registravka4s-core_2.13:latest.release
[error]   No latest release version found in file:/home/max/.ivy2/local/com.streese.registravka4s/registravka4s-core_2.13/
[error]   not found: https://repo1.maven.org/maven2/com/streese/registravka4s/registravka4s-core_2.13/maven-metadata.xml
[error]   not found: https://packages.confluent.io/maven/com/streese/registravka4s/registravka4s-core_2.13/maven-metadata.xml
[error]         at coursier.Resolve$.$anonfun$validate$1(Resolve.scala:323)
[error]         at scala.collection.immutable.List.map(List.scala:246)
[error]         at scala.collection.immutable.List.map(List.scala:79)
[error]         at coursier.Resolve$.validate(Resolve.scala:321)
[error]         at coursier.Resolve.validate0$1(Resolve.scala:115)
[error]         at coursier.Resolve.$anonfun$ioWithConflicts0$4(Resolve.scala:161)
[error]         at coursier.util.Task$.$anonfun$flatMap$extension$1(Task.scala:14)
[error]         at coursier.util.Task$.$anonfun$flatMap$extension$1$adapted(Task.scala:14)
[error]         at coursier.util.Task$.wrap(Task.scala:84)
[error]         at coursier.util.Task$.$anonfun$flatMap$2(Task.scala:14)
[error]         at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:434)
[error]         at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[error]         at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[error]         at java.base/java.lang.Thread.run(Thread.java:834)

However when I run the code with the other module (avro4s) then everything works as expected.

What I cannot wrap my head around is the error description which states that the file https://repo1.maven.org/maven2/com/streese/registravka4s/registravka4s-core_2.13/maven-metadata.xml does not exist but it actually does. And what is more is it looks equivalent to https://repo1.maven.org/maven2/com/sksamuel/avro4s/avro4s-core_2.13/maven-metadata.xml, as does the whole directory structure. So I do not get how registravka4s is different from avro4s here in such a way that for one the code fails and for the other it does not.

3 replies

Nishant Vishwakarma

@nishantv12

I am getting this error when trying to do sbt compile on a project

 coursier.ResolutionException: Exception during resolution
[error] Caused by: java.io.FileNotFoundException: <path to artifactory>/artifactory/typesafe-ivy-releases/org.junit.vintage/junit-vintage-engine/5.7.0/ivys/ivy.xml.sha1.lock (No such file or directory)

I am using sbt 1.3.13. I have checked and the dependency is present in the remote artifactory. The repostories configuration is proper. I am confused because I don't see an attempt to try to resolve this from the remote repository as it is not present in cache. What am I missing?

Anton Sviridov

@keynmol

If I get

Exception in thread "main" coursier.cache.ArtifactError$DownloadError: download error: Caught java.net.MalformedURLException: unknown protocol: zip+https (unknown protocol: zip+https) while downloading zip+https://github.com/sbt/sbt/releases/download/v1.4.6/sbt-1.4.6.zip!sbt/bin/sbtn-x86_64-pc-linux

when running coursier install sbtn - where should I look for issues? old coursier version? jdk issue?

Chris Kipp

@ckipp:matrix.org

[m]

Anyone have any idea if this is supposed to work coursier/coursier#1700 I just hit on this again and forgot I created an issue for it long ago

Boris Steiner

@bs76

Hi all, when I try to symlink ~/.local/share/coursier/bin/cs to ~/bin/cs then running ~/bin/cs fails to run. The path of .cs.aux is being 'resolved' via dirname which resolves the dirname of the symlink, not to the actual cs under ~/.local;

looking at ~/.local/.../cs adding readlink $(dirname $(readlink -f "$0")) solves this issue

Chris Kipp

@ckipp:matrix.org

[m]

2021-01-25 21.41.22.gif

Is --progress supposed to completely hide any progress at all?

Like should I be seeing this with progress set to false?

Lorenzo Gabriele

@lolgab

Hi everyone :-)
Does coursier need special treatment to update GraalVM to 21.0.0 ? If so, is it tracked somewhere?

Shane Delmore

@ShaneDelmore

I have a question I wasn't able to answer reading the docs, how do I set the scala version for zinc? For example, when I try to download zinc, it tells me it ca't find a scala version suffix for zinc, but I have entered it right here

cs fetch org.scala-sbt::zinc_2.12:1.4.4
Exception in thread "main" coursier.install.AppArtifacts$ScalaDependenciesNotFound: Can't find a scala version suffix for org.scala-sbt::zinc_2.12:1.4.4

Shane Delmore

@ShaneDelmore

Although cs complete can find it

❯ cs complete org.scala-sbt:zinc_2.12
zinc_2.12

Tobias Roeser

@lefou

@ShaneDelmore Either add the _2.12 OR the double colon :: between org and name, but not both.

Shane Delmore

@ShaneDelmore

Thanks @lefou, I never would have figured that out on my own.

And if I use ::, is there a way to set scala version, or does it just always use 2.13?

That's just a question out of curiousity, the single colon worked great.

Tobias Roeser

@lefou

Can't tell you where the default comes from. I guess, it's the scala version used by ammonite, so atm 2.13.x

Sorry, I was asuming your using ammonite, but actually I don't know the context, so I can't tell you

Shane Delmore

@ShaneDelmore

No ammonite, just cs fetch org.scala-sbt::zinc_2.12:1.4.4

Or, in this case, when doing cs fetch org.scala-sbt::zinc:1.4.4 how does it decide which scala version?

No worries if you don't know.

Siddhant Sanyam

@siddhant3s

COURSIER_REPOSITORIES="https://mycompany.com/nexus/content/groups/public" COURSIER_CACHE=/tmp/yo/ coursier fetch scalafmt

Exception in thread "main" coursier.install.AppArtifacts$ScalaDependenciesNotFound: Can't find a scala version suffix for org.scalameta::scalafmt-cli:latest.release (likely a non existing module or version)

I'm getting this exception when I'm trying coursier fetch with a private repository. Anyone has any idea what might be going on?

Eric K Richardson

@ekrich

The interface for Scala Native has changed a bit in 0.4.0 although the old interface still works but is deprecated. I didn't see any issues or PRs - is this update being considered?

Siddhant Sanyam

@siddhant3s

I guess I'm not understanding coursier's repo resolution at all:
I've set my mirrors.properties to point central.to correctly my local maven proxy. On top of that, I'm passing -r https://maven.company.com/nexus/content/groups/public --no-default to coursier. Even then... it's trying to connect to repo1.maven.org. I don't understand why.

Ondra Pelech

@sideeffffect

Hello, when using coursier/cache-action, we're seeing warnings like reserveCache failed. Is it OK? Or is something going wrong? /cc @mijicd
coursier/cache-action#102

Oliver

@xthemage:synapse.xthemage.net

[m]

Hi folks. First off, fantastic tool. Coursier bootstrap is amazing! I've been noticing that recent versions of coursier have been embedding the primary jar file in the bootstrap binary. Is there a way to disable this feature?

1 reply

(or perhaps am I using it wrong?)

Specifically, I have a little bit of a hack that relies on python's ability to execute a tar file to package python code with my jar, and recently I've noticed that bootstrap binaries are seeing the classloader reading from path/to/bootstrap!coursier/bootstrap/launcher/jars/___.jar instead of the typical file:/path/to/__main__.py or jar:/path/to/___.jar

Oliver

@xthemage:synapse.xthemage.net

[m]

Hmm... is coursier automatically packaging files that aren't visible to a global resolver? If so, is there a command-line flag that will turn this behavior into an error?

ekrich

@ekrich:matrix.org

[m]

I have been trying to get the Scala tool set to work behind a corp proxy with basic auth. The following meta issue was added - scalameta/metals#2485 I did some analysis starting at the very beginning.

Siddhant Sanyam

@siddhant3s

Hi, I'm trying to use a local maven repo. When I do coursier fetch scalafmt it fails with Caused by: coursier.install.AppArtifacts$ScalaDependenciesNotFound: Can't find a scala version suffix for org.scalameta::scalafmt-cli:latest.release (likely a non existing module or version)

However when I write the exact version number (after consulting the internet on whatever the latest version, couriser succeeds):

[siddhant@localhost ~] coursier fetch org.scalameta:scalafmt-cli_2.13:2.7.5

Does anyone have ideas as to what might be going on or how do I debug this?

I tried coursier fetch org.scalameta::scalafmt-cli:2.7.5 but that doesn't work either (notice the ::)

Eric K Richardson

@ekrich

I was trying to see if I could make some changes using this as a guide. If I look at the script it looks like it calls main in Coursier but if I put some System.err.println in there I see nothing so I am thinking I am missing something.

Emily Chen

@six5532one

Hi, I'm using Homebrew 3.0.0 and tried brew install coursier/formulas/coursier and brew tap coursier/formulas. Each time, I get these errors:

Error: Invalid formula: /usr/local/Homebrew/Library/Taps/coursier/homebrew-formulas/coursier.rb
coursier: Unsupported special dependency :java
Error: Cannot tap coursier/formulas: invalid syntax in tap!

Siddhant Sanyam

@siddhant3s

What's the difference between bootstrap --standalone and bootstrap --assembly ?

Przemek Pokrywka

@przemek-pokrywka

Hi @lolgab

Does coursier need special treatment to update GraalVM to 21.0.0 ? If so, is it tracked somewhere?

Coursier uses a JSON file with an index of JVMs from Jabba project. Version 21.0 of GraalVM was only recently added there. For some reason Coursier doesn't pick this up automatically, but if you pass an additional option, the new GraalVM can be used. The option is

--jvm-index https://raw.githubusercontent.com/shyiko/jabba/master/index.json

Lorenzo Gabriele

@lolgab

@przemek-pokrywka Thank you very much :pray:

StinkyLord

@StinkyLord

Hi guys

anybody knows how to get coursierDependencyTree by specific scope/s?

i can see support when i run sbt test:coursierDependencyTree but it is not working the same for
provided/import/runtime..
just for test/compile..
any idea where i can find documentation about this?

Mark T. Kennedy

@mtk

is there a way to ask coursier to tell me what could be updated without actually updating anything?

StinkyLord

@StinkyLord

is this forum even alive?:D

Przemek Pokrywka

@przemek-pokrywka

@StinkyLord semi-alive. I may be wrong but Coursier doesn't support the concept of scopes at the moment I think.

StinkyLord

@StinkyLord

it's weird because this sbt test:coursierDependencyTree syntax work fine.. and i checked the source code it has support for scopes.. i wonder why its not official in the docs

Henry

@hygt

hello, is there a way to make thin bootstraps not point to maven central? or should I build standalone bootstraps?

2 replies

Justin Kaeser

@jastice

Can I use the API to resolve hashes and signatures besides just the artifacts and classifiers? i.e. the whole repo

7 replies

Simon Parten

@Quafadas

Can anyone see why this might be giving me the below errors?

./coursier --help --no-default -r "https://repo.corp.com/repository/maven-public/"

It appears to be ignoring the command line args?

Error while downloading https://repo1.maven.org/maven2/com/github/alexarchambault/case-app_2.12/2.0.0-M9/case-app_2.12-2.0.0-M9.jar: Connection reset, ignoring it
Error while downloading https://repo1.maven.org/maven2/com/github/alexarchambault/argonaut-shapeless_6.2_2.12/1.2.0-M11/argonaut-shapeless_6.2_2.12-1.2.0-M11.jar: Connection reset, ignoring it
Error while downloading https://repo1.maven.org/maven2/com/github/alexarchambault/case-app-util_2.12/2.0.0-M9/case-app-util_2.12-2.0.0-M9.jar: Connection reset, ignoring it
Error while downloading https://repo1.maven.org/maven2/com/chuusai/shapeless_2.12/2.3.3/shapeless_2.12-2.3.3.jar: Connection reset, ignoring it
Error while downloading https://repo1.maven.org/maven2/com/github/alexarchambault/case-app-annotations_2.12/2.0.0-M9/case-app-annotations_2.12-2.0.0-M9.jar: Connection reset, ignoring it

5 replies

Where communities thrive

People

Repo info

Activity