coursier/coursier

Pure Scala Artifact Fetching

mtjon-gitter

@mtjon-gitter

Hi just got myself an ARM-based Apple computer and tried installing Java, Scala, sbt, etc. through coursier. It appears to work for Java (adopt-openj9:1.8.0-292) and Scala (2.13.6). But when launching sbt I am presented with the following error:

❯ sbt [info] [launcher] getting org.scala-sbt sbt 1.5.5 (this may take some time)... assertion failed [found_x86_offset]: no instruction entry found for jit breakpoint at arm address 0x10838cbb0 (TranslationCacheJit.cpp:300 handle_jit_breakpoint)

I don't see anything on this on the docs so was hoping someone could help me out with this. I'd prefer to install everything thsough one manager (coursier) and not have to install e.g. sbt through brew. Thanks!

Omid

@karamiomid

Hi Gitter Guys!

I'm trying to install this command "cs setup --jvm adopt:11" I have some errors. Please help me!

Exception in thread "main" coursier.cache.ArtifactError$DownloadError: download error: Caught javax.net.ssl.SSLHandshakeException (PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target) while downloading https://github.com/AdoptOpenJDK/openjdk11-binaries/releases/download/jdk-11%2B28/OpenJDK11-jdk_x64_mac_hotspot_11_28.tar.gz

Eugene Medvediev

@eugenemedvediev

Hello, I have a problem with updating bloop to latest version:
I have Ubuntu 20.04 and have installed bloop via coursier. Current version is bloop v1.4.10-8-8d1cbc4f.
I see no errors when I execute command cs update bloop. I even uninstall bloop and install again, but somehow it installs version 1.4.10, even if 1.4.11 is available.
Looks like it uses already downloaded version and only copying it to ~/.local/share/coursier/bin/bloop location.
What is the way to install latest bloop?

Eugene Medvediev

@eugenemedvediev

❯ cs install bloop
https://repo1.maven.org/maven2/ch/epfl/scala/bloopgun_2.12/maven-metadata.xml
No new update since 2021-11-02 20:11:03
Wrote bloop

~/.cache/coursier/v1/https/repo1.maven.org/maven2/ch/epfl/scala/bloop-launcher_2.12
❯ bloop about
bloop v1.4.10-8-8d1cbc4f

but if I follow the link, then latest version is 1.4.11

1 reply

Miuler

@miuler:matrix.org

[m]

image.png

have you tried with: cs update bloop ? @eugenemedvediev

Tomasz Godzik

@tgodzik

You also need to stop the server first with bloop ng-stop and then do any other Bloop command

render1980

@render1980

Hello!
I'm wondering if https://logging.apache.org/log4j/2.x/security.html could affect https://github.com/coursier/sbt-coursier

See that there is log4j as a third-party dependency:

io.get-coursier:lm-coursier_2.12:2.0.9+5-935e59c8+20211213-1307-SNAPSHOT [S]
  +-io.get-coursier:coursier_2.12:2.1.0-M1-1
  ...
  |
  +-org.scala-sbt:librarymanagement-ivy_2.12:1.3.4 [S]
  ...
    +-org.scala-sbt:librarymanagement-core_2.12:1.3.4 [S]
    ...
       +-org.scala-sbt:util-logging_2.12:1.3.3 [S]
       | +-org.apache.logging.log4j:log4j-core:2.11.2
       | | +-org.apache.logging.log4j:log4j-api:2.11.2

Tim Steinbach

@NeQuissimus

Hello. Homebrew just upgraded me to Coursier 2.1.0-M1 yesterday. The one thing that stood out for my use case is coursier/coursier#2188 I can set COURSIER_ARCHIVE_CACHE and then things such as cs setup --jvm adopt:1.11.0-11 will write into that folder. However, the JAVA_HOME ends up looking similar to the following:

.coursier.d/https/github.com/AdoptOpenJDK/openjdk11-binaries/releases/download/jdk-11.0.11%252B9/OpenJDK11U-jdk_x64_mac_hotspot_11.0.11_9.tar.gz/jdk-11.0.11+9/Contents/Home/

Is there currently a way to get a more direct route to JAVA_HOME? What I mean by that is that when I say adopt:1.11.0-11, the actual PATH is fairly unpredictable. I would like to know JAVA_HOME without calling cs java --envif at all possible. Maybe something like $COURSIER_ARCHIVE_CACHE/jvm/$JDK_SHORTNAME would be amazing as a symlink into the directory structure. So I suppose my question here is whether something similar already exists. And if not, I would to contribute such functionality but am having a bit of a hard time finding where exactly these paths would be built. Is modules/jvm/src/main/scala/coursier/jvm/JvmCache.scala a good place to start?

Bernie

@WorkDayHeyHey

Does Coursier support ssh resolvers?

I have used an ssh resolver in SBT for years and I like it. But I can't make it work in the current environment. The SBT doc is unchanged, but I am getting an error out of coursier.internal.PlatformRepositoryParser:89. I guess I'm not saying Maven or Ivy repo type.

Olivier Mélois

@Baccata

It might be a dumb question : have scalajs bootstraps been considered ?

A. Alonso Dominguez

@alonsodomin

hi all, wondering if any of the maintainers could take a look at the following PR and give some feedback (or at least trigger the CI build): coursier/coursier#2317

msolomon-ck

@msolomon-ck

Hey all, I'm having trouble getting coursier to discover new versions of a dependency even when setting coursier_mode and coursier_ttl to the following

export COURSIER_TTL="0s"
export COURSIER_MODE="update-local-changing,offline,missing"

The dependency in question is an sbt plugin and is wildcarding on the patch version like so 1.2.+. I'm hoping that when new patch versions of the dependency are published coursier will automatically discover and download them but as of right now it doesn't seem like that's happening. Also, the maven-metadata.xml file in the local coursier cache does not match the file in the remote repository, the local file seems to be a few versions behind. Wondering if anyone has thoughts on what I can try to make this work the way I'm expecting it to, thanks in advance!

1 reply

Vijay Emmanuel PAZHEPARAMPIL

@vijayemmanuel

I am using the standalone JAR coursier (V 2.1.0 M2) to set up scala .

$  ./coursier install -r https://username:password@artifactory.corp:443/artifactory/r-XXX-virtual scala
https://artifactory.corp:443/artifactory/r-XXX-virtual/io/get-coursier/apps/maven-metadata.xml
  No new update since 2021-11-16 00:52:42
Exception in thread "main" coursier.error.ResolutionError$CantDownloadModule: Error downloading org.scala-lang:scala-compiler:latest.stable
  download error: Caught javax.net.ssl.SSLException (Connection reset) while downloading https://repo1.maven.org/maven2/org/scala-lang/scala-compiler/maven-metadata.xml
        at coursier.Resolve$.$anonfun$validate$1(Resolve.scala:347)
        at scala.collection.TraversableLike.$anonfun$map$1(TraversableLike.scala:286)
        at scala.collection.Iterator.foreach(Iterator.scala:943)
        at scala.collection.Iterator.foreach$(Iterator.scala:943)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1431)
        at scala.collection.IterableLike.foreach(IterableLike.scala:74)
        at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
        at scala.collection.TraversableLike.map(TraversableLike.scala:286)
        at scala.collection.TraversableLike.map$(TraversableLike.scala:279)
        at scala.collection.AbstractTraversable.map(Traversable.scala:108)
        at coursier.Resolve$.validate(Resolve.scala:345)
        at coursier.Resolve.validate0$1(Resolve.scala:117)
        at coursier.Resolve.$anonfun$ioWithConflicts0$4(Resolve.scala:167)
        at coursier.util.Task$.$anonfun$flatMap$extension$1(Task.scala:14)
        at coursier.util.Task$.$anonfun$flatMap$extension$1$adapted(Task.scala:14)
        at coursier.util.Task$.wrap(Task.scala:82)
        at coursier.util.Task$.$anonfun$flatMap$2(Task.scala:14)
        at scala.concurrent.Future.$anonfun$flatMap$1(Future.scala:307)
        at scala.concurrent.impl.Promise.$anonfun$transformWith$1(Promise.scala:41)
        at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

Any idea why the custom repository '-r' is not considered? I am in a enterprise environment and we cannot use repo1.maven.org.

A. Alonso Dominguez

@alonsodomin

hi all, wondering if any of the maintainers could take a look at the following PR and give some feedback (or at least trigger the CI build): coursier/coursier#2317

giving some visibility to this, if any of the maintainers is around, could this PR be reviewed please?

Mark T. Kennedy

@mtk

right now metals v0.11.0 wants bloop v1.4.12. but cs (even after a 'cs update') has bloop 1.4.11 installed. a 'cs uninstall bloop' followed by a 'cs install bloop' still downloads 1.4.11. the online doc for a cs install of bloop lists the current version as 1.4.12. i'm confused :-).

Mark T. Kennedy

@mtk

belay that question. it just needed to be restarted.

A. Alonso Dominguez

@alonsodomin

just a quick reminder for the maintainers that this PR is waiting again for approval: coursier/coursier#2317. Last time it failed because of the code format check made by scalafmt, I reformatted the code and pushed new changes.

Thijs Broersen

@ThijsBroersen

Is coursier setup currently broken? I get the following on any env I try to install it:

Checking if the standard Scala applications are installed
  Installed ammonite
Error downloading gz+https://github.com/coursier/coursier/releases/download/v2.1.0-M5-1-gc8a0a64bd/cs-x86_64-pc-linux.gz

simonjscott

@simonjscott

I've run into a problem with artefact resolution using sbt-coursier 2.0.10, sbt 1.2.6, on Windows 10. My compilations are failing because a needed artefact can't be found on the classpath. What seems to be happening is that, if an artefact is already present in my local .m2 repo, then coursier doesn't add the artefact's location to the classpath. If I remove the artefact from the .m2 repo, then coursier downloads and everything works. Does this sound familiar to anyone? I am wondering if it is related to this issue: coursier/coursier#372

2 replies

Chris Kipp

@ckipp:matrix.org

[m]

maybe not the answer you're looking for, but depending on why you are using sbt-coursier, you could just consider using mainline sbt without sbt-coursier since as of 1.4.x it uses coursier by default

1 reply

since you are on a pretty old version of sbt

Chris Kipp

@ckipp:matrix.org

[m]

but rather your coursier cache location

Gideon Potok

@GideonPotok

[error] (update) lmcoursier.internal.shaded.coursier.error.FetchError$DownloadingArtifacts: Error fetching artifacts:
[error] https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.10.2/avro-mapred-1.10.2-hadoop2.jar: not found: https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.10.2/avro-mapred-1.10.2-hadoop2.jar
[error] Total time: 3 s, completed Feb 18, 2022 10:01:42 PM

What is my next move?

anyone want to dm me and help me walk through some dependency issues?

Steve Jones

@sjfloat

Is anyone else aware of problems with coursier? I seem to be limited to scala 3

cs install scala:2.13.1
https://repo1.maven.org/maven2/io/get-coursier/apps/maven-metadata.xml
  No new update since 2022-02-06 13:51:21
Exception in thread "main" coursier.error.ResolutionError$CantDownloadModule: Error downloading org.scala-lang:scala3-compiler_3:2.13.1
  not found: https://repo1.maven.org/maven2/org/scala-lang/scala3-compiler_3/2.13.1/scala3-compiler_3-2.13.1.pom

Steve Jones

@sjfloat

OK, problem was an old cs executable

sunLightLeaf

@sunLightLeaf

Hi! I have a problem with cs setup - it throws java.util.zip.ZipException: invalid entry CRC (expected 0x8899ec42 but got 0xd4a7d99d). I've checked my jars, and none seem to be corrupted. What might be the problem here?..

Lakin Wecker

@lakinwecker

I'm running into something similar, except I was just trying to install scalafmt

Looks like you also reported it on github and it's a known issue with arch linux and calculating CRCs, which is fun

skestle

@skestle

@vijayemmanuel did you figure this out? Unfortuantely, I have no idea how to determine what my cs/coursier version is.
:point_up: January 8, 2022 8:36 PM

I can successfully run fetch, but not install

Vijay Emmanuel PAZHEPARAMPIL

@vijayemmanuel

@skestle It is working after I set the coursier credentials property file as described in https://get-coursier.io/docs/other-credentials. I ignored the realm property and install command worked.

skestle

@skestle

@vijayemmanuel Ah - I see, you were requiring credentials. Mine has none. I've raised coursier/coursier#2405, since even if such a fix is available, it's a bug that it won't tell you anything about the problem

Florian Schmaus

@Flow_gitlab

I am in the process of packaging coursier for my Gentoo overlay and wonder about the versioning scheme. The latest coursier release is 2.1.0-M5, is the -M part like a pre-release for 2.1.0?

Kevin Sjöberg

@kevinsjoberg

:wave: I'm new to Scala (started today) and I'm trying to understand how Coursier fit into everything. Would anyone mind explaining a bit? I installed it on my M1 MBP (But I still it runs under Rosetta since it doesn't support Apple Sillicon?) and it required me to have OpenJDK installed. Once installed, I run cs setup and it installs yet another JDK, including some tools like amm, sbt, scala and scalafmt. I'm trying to follow the Functional Programming Principles in Scala course on Coursera but ran into problem when they asked me to run sbt in the example project. Instead of starting the sbt prompt I got the following error:

~/code/scala-course $ sbt
[info] [launcher] getting org.scala-sbt sbt 1.5.0  (this may take some time)...
java.lang.ClassCastException: class java.lang.UnsupportedOperationException cannot be cast to class xsbti.FullReload (java.lang.UnsupportedOperationException is in module java.base of loader 'bootstrap'; xsbti.FullReload is in unnamed module of loader 'app')
    at sbt.internal.XMainConfiguration.run(XMainConfiguration.java:59)
    at sbt.xMain.run(Main.scala:46)
    at xsbt.boot.Launch$.$anonfun$run$1(Launch.scala:149)
    at xsbt.boot.Launch$.withContextLoader(Launch.scala:176)
    at xsbt.boot.Launch$.run(Launch.scala:149)
    at xsbt.boot.Launch$.$anonfun$apply$1(Launch.scala:44)
    at xsbt.boot.Launch$.launch(Launch.scala:159)
    at xsbt.boot.Launch$.apply(Launch.scala:44)
    at xsbt.boot.Launch$.apply(Launch.scala:21)
    at xsbt.boot.Boot$.runImpl(Boot.scala:78)
    at xsbt.boot.Boot$.run(Boot.scala:73)
    at xsbt.boot.Boot$.main(Boot.scala:21)
    at xsbt.boot.Boot.main(Boot.scala)
[error] [launcher] error during sbt launcher: java.lang.ClassCastException: class java.lang.UnsupportedOperationException cannot be cast to class xsbti.FullReload (java.lang.UnsupportedOperationException is in module java.base of loader 'bootstrap'; xsbti.FullReload is in unnamed module of loader 'app')

After some debugging on my part, it looks like Coursier installed sbt, version 1.6.2 and the project had configured sbt.version=1.5.0. Changing this to sbt.version=1.6.2 instead, solved the problem.

What I'm not entirely sure about is what's the purpose of Coursier. To manage multiple installs of apps and JDKs? That was my initial thought, but it doesn't look like it as it wants me to put hardcoded paths in my .bash_profile for a vert specific JDK.

I'm super confused right now, so any high level overview would be much appreciated. :slight_smile:

Florian Schmaus

@Flowdalic

@kevinsjoberg does https://get-coursier.io/docs/cli-java help?

I don't think there is any reason for coursier being able to manage JVM installs (alongside JVM-based app installs) that requires one to push hardcoded paths in .bash_profile

all that is needed is ~/.local/share/coursier/bin in your PATH

Where communities thrive

People

Repo info

Activity