coursier/coursier

Pure Scala Artifact Fetching

Damian Reeves

@DamianReeves

Hi. I posted this discussion some time ago (https://github.com/coursier/coursier/discussions/2404) and was hoping someone could help me figure this out.

My company has a proxy repository which all artifact access is fronted by.
As such in sbt, we use the configuration details mentioned here: https://www.scala-sbt.org/1.x/docs/Proxy-Repositories.html#sbt+Configuration in order to configure sbt to correctly resolve artifacts.

The docs referenced speak to a block like this:

[repositories]
  local
  my-ivy-proxy-releases: http://repo.company.com/ivy-releases/, [organization]/[module]/(scala_[scalaVersion]/)(sbt_[sbtVersion]/)[revision]/[type]s/[artifact](-[classifier]).[ext]
  my-maven-proxy-releases: http://repo.company.com/maven-releases/

This works great for sbt, but I am trying to accomplish the same in the coursier CLI (as well as in mill, which I know is outside the scope of this repo).
What would be the raw coursier configuration way to accomplish what sbt does? I'm interested both in how to do this with config files, i.e. using coursier.mirrors, using environment variables and finally using command line options.

What's of particular note is how to configure the ivy pattern in coursier as shown in sbt.

Peng Cheng

@tribbloid

How to cs list showing all versions?

Olivier Mélois

@Baccata

Hey folks, I'm trying to download a binary executable from :

https://repo1.maven.org/maven2/io/grpc/protoc-gen-grpc-java/1.47.0/

unfortunately, the binaries are not listed in the pom file, so setting types/classifiers in coursier dependencies is not helping. Does coursier allow for downloading a file without it being referenced in the pom ?

Olivier Mélois

@Baccata

(above was a user problem, no need to worry)

Chris Kipp

@ckipp:matrix.org

Inside of a DependencyTree there is a reconciledVersion and a retainedVersion. Anyone know the difference?

Chris Kipp

@ckipp:matrix.org

Alright so the above just bit me. Looking at the scaladocs I see

  /** The final version of this dependency. */
  def retainedVersion: String

which made me think I'd want that if ultimately I wanted the actual retained version, but in cases where a version range is used in Java, this still spits out the range whereas reconciled doesn't. For example

version: [2.8.6,2.9)
retrained: [2.8.6,2.9)
reconciled: 2.8.9

how come retained is still a range?

since in reality that will never be the "final" version

Tobias Roeser

@tobiasroeser:matrix.org

Hi, how is coursier built noawdays? I can't even run the simples instructions for DEVELOP.md

E.g.

Eric K Richardson

@ekrich

I went down that path awhile back and couldn't make progress either - if you find out please let me know here.

Tobias Roeser

@tobiasroeser:matrix.org

Sure, but this is really frustrating. Not the first time it tried. There are also lots of issues which should at least receive some response, but nothing.

I mean, saying "I don't care", or "please can somebody else help out" is a better response than quietness.

Eric K Richardson

@ekrich

I totally agree man - I got no help at all - redirect/forward doesn't work with basic auth and I wanted to fix it but I could never get to a point where I could do anything. Maybe the scala-cli team could help us.

ekrich

@ekrich:matrix.org

This message is replying to a Matrix event but we were unable to find associated bridged Gitter message to put it in the appropriate threaded conversation.

I get past this one.

Tobias Roeser

@tobiasroeser:matrix.org

Reposting my build error, as it seems it didn't make it from Matix to Gitter.

17:44:11 θ60° lefou:~/work/opensource/coursier master+* 1 ± mill core.jvm[2.13.6].compile
[7/65] core.jvm[2.13.6].publishVersion 
[42/65] util.jvm[2.13.6].compile 
Compiling project (Scala 2.13.6, JVM)
Warning: 2 feature warnings; re-run with -feature for details
java.nio.file.ClosedFileSystemException
Error compiling project (Scala 2.13.6, JVM)
        at jdk.zipfs/jdk.nio.zipfs.ZipFileSystem.ensureOpen(ZipFileSystem.java:1619)
        at jdk.zipfs/jdk.nio.zipfs.ZipFileSystem.getFileAttributes(ZipFileSystem.java:531)
        at jdk.zipfs/jdk.nio.zipfs.ZipPath.readAttributes(ZipPath.java:767)
        at jdk.zipfs/jdk.nio.zipfs.ZipPath.readAttributes(ZipPath.java:777)
        at jdk.zipfs/jdk.nio.zipfs.ZipFileSystemProvider.readAttributes(ZipFileSystemProvider.java:276)
        at java.base/java.nio.file.Files.readAttributes(Files.java:1851)
        at java.base/java.nio.file.Files.size(Files.java:2468)
        at sbt.internal.inc.HashUtil$.farmHash(HashUtil.scala:31)
        at sbt.internal.inc.FarmHash$.ofPath(Stamp.scala:89)

Naftoli Gugenheim

@nafg

Can someone explain this?

❯ cs resolve com.zaxxer:HikariCP:4.0.0
https://repo1.maven.org/maven2/com/zaxxer/HikariCP/4.0.0/HikariCP-4.0.0.pom
  100.0% [##########] 25.3 KiB (316.4 KiB / s)
com.zaxxer:HikariCP:4.0.0:default
org.slf4j:slf4j-api:2.0.0-alpha1:default

But https://repo1.maven.org/maven2/com/zaxxer/HikariCP/4.0.1/HikariCP-4.0.1.pom doesn't show 2.0.0-alpha1. It uses a property syntax:

<dependency>
<groupId>org.slf4j</groupId>
<artifactId>slf4j-api</artifactId>
<version>${slf4j.version}</version>
</dependency>

Chris Kipp

@ckipp:matrix.org

@nafg: if you look at the entry for slf4j.version in the pom https://repo1.maven.org/maven2/com/zaxxer/HikariCP/4.0.0/HikariCP-4.0.0.pom it is 2.0.0-alpha1. So resolver here is showing you the fully resolved deps

Tobias Roeser

@tobiasroeser:matrix.org

There are different property values for ${slf4j.version} in different profiles, which get auto-enabled depending on the executing Java version. Probably not the best idea, but within the Maven POM specs.

Naftoli Gugenheim

@nafg

OH WOW

Rahul Kumar

@rahulkumarsahu

Hi I am reading all dependencies from pom.xml using go lang and I want to download all those dependencies using coursier cli how can we do that with the help of go lang

Bjorn Regnell

@bjornregnell

Linking to scala user if someone would like to respond there to a bad install experience post:
https://users.scala-lang.org/t/startup-of-scala-3-on-windows-poor/8693

Carlos Eduardo de Paula

@carlosedp:matrix.org

Hi all, I'm installing scala tools using coursier and one of them is ammonite. when I install it using cs install ammonite, it installs the latest version but by default it install the scala 2.13 version.

I'd like to install the scala 3 version. is it possible?

I checked and there is ammonite built for all versions

gvolpe

@gvolpe:matrix.org

Hi folks, is it possible to complete snapshots dependencies? e.g.

$ cs complete-dep -r sonatype:snapshots org.scalameta:metals_2.13:0.11.8 
0.11.8

At the moment it only seems to resolve releases.

Or do you recommend another way of finding out the latest snapshot version of a dependency from the terminal?

2 replies

Chris Kipp

@ckipp:matrix.org

I see you're using Metals as an example but if you're doing it for metals you can set your version in nvim-metals as latest.snapshot and it will pull it for you

or if you don't want that you can have a little script that hits https://scalameta.org/metals/latests.json which will tell you the latest versions

Zhenhao Li

@Zhen-hao

hi there, can anyone tell me how to convert a value of lmcoursier.definitions.Dependency to coursier.core.Dependency?
As a beginner with this project, the purpose of lmcoursier is not very clear to me

ghc1001

@ghc1001

Hi - new to Coursier and Scala! i'm looking for a self-contained example / "hello world" on Coursier using Gradle as a build tool (i have to use Gradle because it's used at my company with Java). Specifically I can use Coursier launch using say 'cs launch scala:2.13.15 -- foo.scala' and I want to know how to use 'cs launch' with Gradle.

ghc1001

@ghc1001

hi again - anyone on this (Coursier and Gradle) or am i trying to match apples and pears?

Chris Kipp

@ckipp:matrix.org

hey @ghc1001, what you're trying to do doesn't really make sense to me. Are you trying to just run your build? If so, then you'd want to do that with gradle, not coursier

or are you trying to use coursier to launch a Scala application that has already been published?

I want to know how to use 'cs launch' with Gradle.

Essentially, you don't

you use gradle to launch a gradle project and you can use coursier to launch a published jar

ghc1001

@ghc1001

hey @ckipp:matrix.org, thanks for your reply! i should have clarified. to run my build, yes - i want to use gradle. to build, i need to use 'cs launch' - what i really want to do is swap out the scala compiler in gradle's build process with 'cs launch scalac:2.xxx' or 'cs launch scalac:3.xxx' because that's what my company provides ('cs' is configured to hit an internal artifactory repo so the 'cs launch' pattern is not something i can change). that also means that 'cs' would do the fetching during the build, not gradle. so you're right, i want coursier to launch the internally-published JARs for the scala compiler (and fetch any dependencies internally) under gradle (if that's possible). and then use gradle as usual for run my build.

Chris Kipp

@ckipp:matrix.org

what i really want to do is swap out the scala compiler in gradle's build process with 'cs launch scalac:2.xxx' or 'cs launch scalac:3.xxx' because that's what my company provides

I guess this is the part the confuses me with your use case. cs launch will have nothing to do with gradle. At the point that you're using launch, gradle is no longer in the picture

do you mean you have two artifacts and you want to be able to cs launch both the Scala 2 artifact and the Scala 3 artifact?

what exactly are you trying to launch?

ghc1001

@ghc1001

@ckipp:matrix.org i'm trying to launch both the Scala 2 compiler (for a 2.x build) and the Scala 3 compiler (for a 3.x build), yes. i have two ways to go: 1) with gradle, where i need to specify the dependencies in the build.gradle - something like dependencies {
implementation "org.scala-lang:scala-library:2.13.1"
scalaCompilerPlugins "org.typelevel:kind-projector_2.13.1:0.11.0"
}

@ckipp:matrix.org or 2) with coursier, where i can use 'cs launch scalac:2.13.1 -- foo.scala'

ghc1001

@ghc1001

both methods work (the dependencies are fetched). and here's where i am beyond my depth - i don't know if i can tell gradle to use 'cs launch scalac:2.13.1 -- foo.scala' to build. i think (i could be wrong) that gradle fetches itself and you can only specify dependencies using e.g. the above Groovy code; you can't tell gradle to go do things with coursier. for various internal reasons the coursier way is "cleaner" - but using it alone i'd have to dump Gradle, so i'm trying to get the best of both worlds... hope that makes more sense?

Chris Kipp

@ckipp:matrix.org

do you have to use gradle for this?

this all seems very odd

and I'm still not 100% sure what you mean

ghc1001

@ghc1001

@ckipp:matrix.org your answer tells me everything ;-) new to this - exploring options. let me tinker and i'll be back in a few days with an update

Tobias Roeser

@tobiasroeser:matrix.org

Hi @alexarchambault. How are we supposed to create a Dependency without access to MinimizedExclusions in coursier 2.1.0-M7?

It's private to coursier package