Register now or log in to join your professional community.
Is it possible to create dynamic partition in spark-sql
Just add the column name with out "=" but you must Define at least one static partition ( should be last in sequence).
for example
Partition by (Name, date=2017)
It is to be declared to the field when create a table using syntax 'parition by <fieldname>'
Partition is the good method to segrate the related values to store into hadoop with multiple areas.