데이터 분석/[Python] 기초
[python] pyspark isnull 개수
INCHELIN
2022. 10. 21. 15:34
728x90
from pyspark.sql import functions as f
df.select([f.count(f.when(f.isnull(c),c)).alias(c) for c,t in df.dtypes if t not in ('timestamp','boolean','date')]).show()
df.select([f.count(f.when(f.isnull(c),c)).alias(c) for c,t in df.columns]).show()
728x90