spark application에 적용된 config 확인 명령어(pyspark 기준)
2021-05-31
.
Data_Engineering_TIL(20210531)
import pprint
sc = spark.sparkContext
pprint.pprint(sc.getConf().getAll())
Minman's
Data Science Study Notes
Data Science Study Notes
.
Data_Engineering_TIL(20210531)
import pprint
sc = spark.sparkContext
pprint.pprint(sc.getConf().getAll())