This document is a collection of best practices for Wrangler CSV parsing and cleansing of CSV files.
General Tips
Parse CSV parse-as-csv should avoid using automatic header determination (parse-as-csv :col â\tâ false). On large files that are distributed across multiple partitions and header is no available to be set in different partitions.