spark map中忽略某些行

用 mapPartiton 

def missingFeatures(stuff): Boolean = ??? // Determine if features is missing

val data = sc.textFile(my_file)
  .flatMap {line =>
    if(missingFeatures(line)) None
    else Some(line)
};