config中指定运行资源

spark = SparkSession.builder.
appName(app_name).
enableHiveSupport().
config("spark.debug.maxToStringFields", "100").
config("spark.executor.memory", "8g").
config("spark.executor.instances","10").
config("spark.executor.cores", "4").
getOrCreate()

原文地址:https://www.cnblogs.com/muyue123/p/15132901.html