Do Scala Sparc RDDs allow objects with reference members -



Do Scala Sparc RDDs allow objects with reference members -

i in stages of designing application using sparc rdds (which don't understand yet). rdd contain big number of objects in turn contain references little number (100) of big (0.5mb) objects immutable.

the operations mapped on rdd phone call fellow member functions on objects in turn phone call fellow member functions on references.

is possible in principle?

spark (not sparc) info passed around using java serialization (unless configure utilize kyro). think right thing big objects. if you're willing customize info bit might best utilize broadcast variables big immutable objects.

scala sparc rdd

Comments

Popular posts from this blog

php - How to pass multiple values from url -

xslt - DocBook 5 to PDF transform failing with error: "fo:flow" is missing child elements. Required content model: marker* -

database - php search bar when I press submit with nothing in the search bar it shows all the data -