Troubleshooting Mixed-Up Fields in Output CSV Files and Solutions

·Apr 05, 2024 04:28 PM

Sonal G. The output CSV is getting fields mixed up. Any idea on why? I.E An Id field from the original CSV might be in the title field in the output csv.

8 comments

· Sorted by Oldest

Sonal G.
·
See if the schema is set correctly?
Brandon M.
·
Schema is set correctly
Brandon M.
·
Could it be ,"Special projects coordinator, executive assistant to the county administrator",
Brandon M.
·
quotes in the csv?
Brandon M.
·
hmm ths might be a me problem -- apologies
Sonal G.
·
There are properties to read csv with quotes https://spark.apache.org/docs/latest/sql-data-sources-csv.html
Sonal G.
·
You can use the above reference as per your data - set the property on the Zingg pipe and it should get picked up
Brandon M.
·
Thanks Sonal G.!
👍1

Sonal G.
·
See if the schema is set correctly?
Brandon M.
·
Schema is set correctly
Brandon M.
·
Could it be ,"Special projects coordinator, executive assistant to the county administrator",
Brandon M.
·
quotes in the csv?
Brandon M.
·
hmm ths might be a me problem -- apologies
Sonal G.
·
There are properties to read csv with quotes https://spark.apache.org/docs/latest/sql-data-sources-csv.html
Sonal G.
·
You can use the above reference as per your data - set the property on the Zingg pipe and it should get picked up
Brandon M.
·
Thanks Sonal G.!
👍1