Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • 22:04
    SethTisue synchronize #1436
  • 22:01
    deanwampler commented #1252
  • 22:00
    deanwampler-domino commented #1253
  • 21:55
    SethTisue commented #1252
  • 21:55
    SethTisue edited #1253
  • 21:55
    SethTisue opened #1253
  • 21:53
    SethTisue commented #1252
  • 21:52
    SethTisue closed #1252
  • 21:46
    SethTisue synchronize #1436
  • 21:39
    deanwampler opened #1252
  • 21:37
    deanwampler opened #2090
  • 18:49
    SethTisue commented #1432
  • 18:48

    SethTisue on 2.13.x

    remove JDK 16 workarounds that … (compare)

  • 18:45
    SethTisue commented #1432
  • 18:40

    SethTisue on 2.13.x

    update JDK 17 expected-to-fail … (compare)

  • 18:39
    SethTisue commented #1432
  • 18:36
    SethTisue commented #9676
  • 18:36
    SethTisue commented #9676
  • 18:36
    SethTisue commented #9676
  • 17:46
    SethTisue edited #1432
Eric K Richardson
@ekrich
It is like SQL where you need to specify the projection (columns) other wise you get and from any joins as well.
D Cameron Mauch
@DCameronMauch
Oh yeah, I tested that too. All the extra columns from both joined df’s are present in the output of the join
I really like the efficiency of DataFrames, but like the type safety of Datasets
Eric K Richardson
@ekrich
Totally agree.
D Cameron Mauch
@DCameronMauch
I wish Frameless was a much better maintained project, as it supposedly gives best of both worlds
As is, my team won’t accept it, because they think it’s half-baked, and no one is maintaining it
Eric K Richardson
@ekrich
Actually, there is not suppose to be any performance hit really with datasets.
D Cameron Mauch
@DCameronMauch
The problem is it can’t optimize lambdas
If you create some dataset of T, and do something with it, it can only do that after it reifies the object.
So even if you only use a handful of the fields in the case class, Spark can’t load only those fields from whatever storage
Seth Tisue
@SethTisue
@ImGrayMouser_twitter seconded that learn-you-a-Scala coding challenges should most definitely not be directing you to use Array
D Cameron Mauch
@DCameronMauch
The only place I would except to see Array in a Scala application is in a main method, to satifying the signature.
Luis Miguel Mejía Suárez
@BalmungSan
Not even there if you use IOApp from cats-effect :grimacing:
Also, I believe Scala 3 will have some something similar to one of the Li' libraries to automatically parse the arguments into a case class, so your main method would not see the Array
Matt Hicks
@darkfrog26
Ugh...80% of my open-source projects now released for Scala 3.
Rob Norris
@tpolecat
:tada:
I'm waiting on a few things but I'm almost done.
Eric K Richardson
@ekrich
Nice job!
Life without macros is easier.
Matt Hicks
@darkfrog26
@ekrich sometimes yes, sometimes no
Eric K Richardson
@ekrich
At least for porting, not for what you are doing :smile:
Seth Tisue
@SethTisue
Luis Miguel Mejía Suárez
@BalmungSan
:tada:
gitleet
@gitleet
I'm confused, why does typesafe config return back java collections?
Luis Miguel Mejía Suárez
@BalmungSan
Well mostly because is a Java library.
gitleet
@gitleet
:) ok the typesafe namespace got me confused
Luis Miguel Mejía Suárez
@BalmungSan
The good news is that transforming a Java collection into a Scala one is pretty easy thanks to the CollectionConverters in the stdlib :)
Matt Hicks
@darkfrog26
@gitleet typesafe-config is pure evil. :-p
Luis Miguel Mejía Suárez
@BalmungSan
You may also want to give a look to pureconfing which is a Scala wrapper over typesafe config.
Matt Hicks
@darkfrog26
I'd recommend Profig or PureConfig (the former being better because I wrote it). :-p
Oh, and Profig doesn't rely on typesafe-config
I'm honestly surprised that typesafe-config is still so widely used
Rob Norris
@tpolecat
I have had pretty good luck with Ciris.
Matt Hicks
@darkfrog26
I've actually never used that one
at first glance it looks a bit complicated
seems a bit problematic that it has custom types
like their enum support
Rob Norris
@tpolecat
It works great.
Matt Hicks
@darkfrog26
@tpolecat thanks, I made a note to look into it further later. :)
econoraptor
@econoraptor
What's the proper way to get from a type to its corresponding class in a macro? I'm trying this, but the TypeDef invocation results in a MatchError on macro expansion TypeDef(TypeRepr.of[T].classSymbol.get)
Seth Tisue
@SethTisue
@econoraptor what if the type doesn't have a corresponding class?
@econoraptor is this Scala 2 or 3, by the way?
econoraptor
@econoraptor
I'm assuming that's why classSymbol is an option. In this specific case it does have a class
scala 3
Seth Tisue
@SethTisue
oh, I only know macros in 2. maybe someone else can help
gitleet
@gitleet

I'm honestly surprised that typesafe-config is still so widely used

probably b/c playframework ships with it

Rob Norris
@tpolecat
I think Akka also uses it.
Eric K Richardson
@ekrich
Scalafmt uses it or sconfig
Nathan Fischer
@nrktkt:matrix.org
[m]
what are the issues with typesafe/lightbend config?
I know a few things I'd like to improve, but nothing really bad comes to mind