Do Scala Sparc RDDs allow objects with reference members -



Do Scala Sparc RDDs allow objects with reference members -

i in stages of designing application using sparc rdds (which don't understand yet). rdd contain big number of objects in turn contain references little number (100) of big (0.5mb) objects immutable.

the operations mapped on rdd phone call fellow member functions on objects in turn phone call fellow member functions on references.

is possible in principle?

spark (not sparc) info passed around using java serialization (unless configure utilize kyro). think right thing big objects. if you're willing customize info bit might best utilize broadcast variables big immutable objects.

scala sparc rdd

Comments

Popular posts from this blog

php - How to pass multiple values from url -

php - Laravel not returning controller -

c# - Confused on how to specify a Platform and Version while using ChromeOptions for RemoteWebDriver with Selenium donNet since recent updates -