mercredi 15 mars 2017

How to work on small portion of big Data File in spark?

I have got big Data file loaded in Spark but wish to work on a small portion of it to run the analysis, is there any way to do that ?. I tried doing repartition but it brings a lot of reshuffling. Is there any good of way of processing the only small chunk of a Big file loaded in Spark?.




Aucun commentaire:

Enregistrer un commentaire