alexarchambault/scalacheck-shapeless

Generation of arbitrary case classes / ADTs with scalacheck and shapeless

Luciano

@lJoublanc

Thanks @joroKr21 will check it out today.

Marko Dimjašević

@mdimjasevic

Hi everyone!

I'd like to generate sequences of valid state machine transitions. Any idea how to do this with scalacheck-shapeless? I was thinking of using IndexedStateT from https://github.com/typelevel/cats/blob/master/core/src/main/scala/cats/data/IndexedStateT.scala to encode an input and output state of a transition.

Ihor Kaharlichenko

@kaharlichenko

Hi. Is there any way I could customize the generator for a case class? Suppose I have case class Person(name: String, age: Int) and I want age to be generated as Gen.posNum, while the rest of the field generators being derived?

Olli Helenius

@liff

@kaharlichenko well if you have arbPerson: Arbitrary[Person] you could do something like:

implicit val properArbPerson: Arbitrary[Person] = Arbitrary(arbPerson.arbitrary.flatMap(person => Gen.posInt.map(age => person.copy(age = age))))

alternatively you could create a distinct type for age, possibly with refined, newtype or otherwise. then you could just create an arbAge: Arbitrary[Age] and not worry about how a Person is generated

Ihor Kaharlichenko

@kaharlichenko

Well, changing the type of age is not an option, since that would involve changing the production code for the sake of testing. The second option is viable, though. Thank you.

Jason Pickens

@steinybot

Do the generated Arbitrarys ignore other implicits in scope? I haven’t been able to confirm or deny yet but it seems to be the case. For example:

case class Foo(bar: Bar)
implicit val arbBar: Arbitrary[Bar] = somePredefinedArbitraryForBar // This is not used
implicit val arbFoo: Arbitrary[Foo] = MkArbitrary[Foo].arbitrary

Jason Pickens

@steinybot

may have been a PBKAC error

Jason Pickens

@steinybot

Does the library work with recursive types?

I’m getting a StackOverflowError but it might just be me again

Paul Snively

@PaulAtFormation

Could someone please offer an example of generating a Shapeless Coproduct, presumably using the aforementioned MkCoproductArbitrary? I'm getting:

could not find implicit value for parameter mkArb: org.scalacheck.derive.MkCoproductArbitrary[takt.data.valkyrie.deployables.etl.VAL1081.ValkyrieType]

Alex

@unthingable

Hello. How does one confine generated String vals for a given case class to non-Unicode characters?

Daniel Sebban

@dsebban

Hi I am getting at runtime

ava.lang.IllegalArgumentException: requirement failed: Duration is limited to +-(2^63-1)ns (ca. 292 years)
[info]  at scala.concurrent.duration.FiniteDuration.<init>(Duration.scala:583)
[info]  at scala.concurrent.duration.Duration$.apply(Duration.scala:31)
[info]  at scala.concurrent.duration.package$DurationLong$.durationIn$extension(package.scala:48)
[info]  at scala.concurrent.duration.package$DurationLong.durationIn(package.scala:48)

is there a way to override the Duration generator implicit with a correct one

Gabriel Assis Bezerra

@gabriel-bezerra

as far as I know, the Arbitrary[T]s in scope are preferred instead of the derived ones

import /*the automatic derivation from the library*/

implicit val arbitraryDuration: Arbitrary[Duration] = ...

implicitly[Arbitrary[SomethingThatNeedsDuration]] // this should use arbitraryDuration

Luciano

@lJoublanc

Was just about to post practically the same question as above ... I have:

case class Dense[K: Field](layout: Layout, stride: Int)

but if I put an implicit val stride: Arbitrary[Int] = ... before forAll, in order to limit the values of stride, it's not being picked up. It sounds like the same problem as above?

Luciano

@lJoublanc

@dsebban how did you finally resolve your issue?

Luciano

@lJoublanc

Ah figured it out - it's the old 'shrink' problem ...

Edmondo Porcu

@edmondo1984

Hello everyone, how can I get my arbitrary for "integers"

to override a default one only for a specific field of a case class?

Luciano

@lJoublanc

Don't think you can do that. You may be able to override the arbitrary for that specific case-class instead though.

Dario Abdulrehman

@dabd

I may be using it incorrectly but I attempted to use scalacheck-shapeless to automatically generate data for a sealed trait hierarchy. It turned out that the generators are very generic and not very useful for my purposes. For example a case class with a String field apparently uses Arbitrary.arbString and that is too generic for my application. Is there a way to customise the generators for a field using the library?

Dario Abdulrehman

@dabd

The only way around it I found is to use tagged types and write Arbitrary implicits.

Georgi Krastev

@joroKr21

I guess depending on your taste you could also just import your own implicit Arbitrary[String]

If you don't mind having orphan typeclass instances

Dario Abdulrehman

@dabd

I suppose @edmondo1984 was asking a similar question above

Dario Abdulrehman

@dabd

@joroKr21 and what if your case class has two different fields of type String which need different instances of Arbitrary. I think in this case you have to use tagged types.

Georgi Krastev

@joroKr21

I'm not sure I would have to check

Dario Abdulrehman

@dabd

The implicit mess + tagged types makes it easier to just hand-craft the case class generators.

Georgi Krastev

@joroKr21

yeah if you want customization might be easier to handroll it

you could use https://christopherdavenport.github.io/cats-scalacheck/

with mapN

In theory it would be easy to make it work with LabelledGeneric

And customize your generators based on the field name

But I don't think it exists in scalacheck-shapeless ATM

Akhtiam Sakaev

@asakaev

Hello. I am getting compiler "stackoverflow" when trying to derive generators for scalapb data.

at scala.tools.nsc.typechecker.Implicits$ImplicitSearch.scala$tools$nsc$typechecker$Implicits$ImplicitSearch$$typedImplicit(Implicits.scala:622)
        at scala.tools.nsc.typechecker.Implicits$ImplicitSearch$ImplicitComputation.rankImplicits(Implicits.scala:1213)
        at scala.tools.nsc.typechecker.Implicits$ImplicitSearch$ImplicitComputation.findBest(Implicits.scala:1248)
        at scala.tools.nsc.typechecker.Implicits$ImplicitSearch.searchImplicit(Implicits.scala:1305)
        at scala.tools.nsc.typechecker.Implicits$ImplicitSearch.bestImplicit(Implicits.scala:1730)
        at scala.tools.nsc.typechecker.Implicits.inferImplicit1(Implicits.scala:112)
        at scala.tools.nsc.typechecker.Implicits.inferImplicit(Implicits.scala:91)
        at scala.tools.nsc.typechecker.Implicits.inferImplicit$(Implicits.scala:88)
        at scala.tools.nsc.Global$$anon$5.inferImplicit(Global.scala:483)
        at scala.tools.nsc.typechecker.Implicits.$anonfun$inferImplicit$1(Implicits.scala:144)
        at scala.tools.nsc.typechecker.Implicits.inferImplicit(Implicits.scala:144)
        at scala.tools.nsc.typechecker.Implicits.inferImplicit$(Implicits.scala:142)
        at scala.tools.nsc.Global$$anon$5.inferImplicit(Global.scala:483)
        at scala.reflect.macros.contexts.Typers.inferImplicitValue(Typers.scala:56)
        at scala.reflect.macros.contexts.Typers.inferImplicitValue$(Typers.scala:54)
        at scala.reflect.macros.contexts.Context.inferImplicitValue(Context.scala:18)
        at scala.reflect.macros.contexts.Context.inferImplicitValue(Context.scala:18)
        at shapeless.LazyMacros$DerivationContext$State$.resolveInstance(lazy.scala:303)
        at shapeless.LazyMacros$DerivationContext.resolve0(lazy.scala:421)
        at shapeless.LazyMacros$DerivationContext.$anonfun$deriveLowPriority$1(lazy.scala:449)
        at scala.Option.flatMap(Option.scala:283)
        at shapeless.LazyMacros$DerivationContext.helper$2(lazy.scala:446)
        at shapeless.LazyMacros$DerivationContext.deriveLowPriority(lazy.scala:483)
        at shapeless.LazyMacros$DerivationContext.derive(lazy.scala:494)
        at shapeless.LazyMacros$DerivationContext$State$.deriveInstance(lazy.scala:327)
        at shapeless.LazyMacrosCompat.deriveInstance(lazymacros.scala:50)
        at shapeless.LazyMacrosCompat.deriveInstance$(lazymacros.scala:33)
        at shapeless.LazyMacros$.deriveInstance(lazy.scala:573)
        at shapeless.LazyMacros.mkImpl(lazy.scala:216)
        at shapeless.LazyMacros.mkStrictImpl(lazy.scala:209)
        at shapeless.LazyMacrosRef.mkStrictImpl(lazyref.scala:39)
        at scala.reflect.macros.runtime.JavaReflectionRuntimes$JavaReflectionResolvers.$anonfun$resolveJavaReflectionRuntime$5(JavaReflectionRuntimes.scala:45)

Can I do something with this or I have big nested type that can not be derived?

Georgi Krastev

@joroKr21

You could try bumping up the stack

I usually go for -Xss2m

Akhtiam Sakaev

@asakaev

@joroKr21 4m already, doesn't helps 🤷‍♂️

Georgi Krastev

@joroKr21

But do you see a loop in the stack trace? From the part you shared I don't.

Also how big is this nested type?

One thing you might try is break it up, i.e. derive generators for the inner types first and then for the outer ones.

Pritam Kadam

@kpritam

Hi,. In the following example, is there a way to create one instance of each subtype predictably, I want to remove randomness and create one instance for each subtype in ADT's?

import org.scalacheck.ScalacheckShapeless._

sealed trait Base
case class BaseIntString(i: Int, s: String) extends Base
case class BaseDoubleBoolean(d: Double, b: Boolean) extends Base

val arb = implicitly[Arbitrary[Base]]
println(arb.sample)
println(arb.sample)
println(arb.sample)

here arb.sample gives random instance for one of the subtype

Felix Palludan Hargreaves

@hejfelix

Trying to derive an arbitrary for a big type from an external library, but getting:

Could not write class arbitraries/package$anon$derivedArbitrary$macro$175$1 because it exceeds JVM code size limits. Method inst$macro$139$lzycompute's code too large!

/**
  * Case class representing a canonical Snowplow event.
  *
  * @see https://github.com/snowplow/snowplow/wiki/canonical-event-model
  */
case class Event(app_id:                   Option[String],
                 platform:                 Option[String],
                 etl_tstamp:               Option[Instant],
                 collector_tstamp:         Instant,
                 dvce_created_tstamp:      Option[Instant],
                 event:                    Option[String],
                 event_id:                 UUID,
                 txn_id:                   Option[Int],
                 name_tracker:             Option[String],
                 v_tracker:                Option[String],
                 v_collector:              String,
                 v_etl:                    String,
                 user_id:                  Option[String],
                 user_ipaddress:           Option[String],
                 user_fingerprint:         Option[String],
                 domain_userid:            Option[String],
                 domain_sessionidx:        Option[Int],
                 network_userid:           Option[String],
                 geo_country:              Option[String],
                 geo_region:               Option[String],
                 geo_city:                 Option[String],
                 geo_zipcode:              Option[String],
                 geo_latitude:             Option[Double],
                 geo_longitude:            Option[Double],
                 geo_region_name:          Option[String],
                 ip_isp:                   Option[String],
                 ip_organization:          Option[String],
                 ip_domain:                Option[String],
                 ip_netspeed:              Option[String],
                 page_url:                 Option[String],
                 page_title:               Option[String],
                 page_referrer:            Option[String],
                 page_urlscheme:           Option[String],
                 page_urlhost:             Option[String],
                 page_urlport:             Option[Int],
                 page_urlpath:             Option[String],
                 page_urlquery:            Option[String],
                 page_urlfragment:         Option[String],
                 refr_urlscheme:           Option[String],
                 refr_urlhost:             Option[String],
                 refr_urlport:             Option[Int],
                 refr_urlpath:             Option[String],
                 refr_urlquery:            Option[String],
                 refr_urlfragment:         Option[String],
                 refr_medium:              Option[String],
                 refr_source:              Option[String],
                 refr_term:                Option[String],
                 mkt_medium:               Option[String],
                 mkt_source:               Option[String],
                 mkt_term:                 Option[String],
                 mkt_content:              Option[String],
                 mkt_campaign:             Option[String],
                 contexts:                 Contexts,
                 se_category:              Option[String],
                 se_action:                Option[String],
                 se_label:                 Option[String],
                 se_property:              Option[String],
                 se_value:                 Option[Double],
                 unstruct_event:           UnstructEvent,
                 tr_orderid:               Option[String],
                 tr_affiliation:           Option[String],
                 tr_total:                 Option[Double],
                 tr_tax:                   Option[Double],
                 tr_shipping:              Option[Double],
                 tr_city:                  Option[String],
                 tr_state:                 Option[String],
                 tr_country:               Option[String],
....

any way to circumvent this?

Where communities thrive

People

Repo info

Activity