Do Scala Sparc RDDs allow objects with reference members -
Do Scala Sparc RDDs allow objects with reference members -
i in stages of designing application using sparc rdds (which don't understand yet). rdd contain big number of objects in turn contain references little number (100) of big (0.5mb) objects immutable.
the operations mapped on rdd phone call fellow member functions on objects in turn phone call fellow member functions on references.
is possible in principle?
spark (not sparc) info passed around using java serialization (unless configure utilize kyro). think right thing big objects. if you're willing customize info bit might best utilize broadcast variables big immutable objects.
scala sparc rdd
Comments
Post a Comment