I have a CSV flat file representing survey results that currently has about 75 columns. In the future, the business may want to add additional questions to the survey, so I may end up with more columns that will need to be imported. Is there any way to automatically incorporate the added columns in existing data flows? Or do I have to update the Flat File Format whenever a column is added? All columns are the same datatype.
You can define the format with a couple hundred columns then use the adaptable schema option in the reader to allow for the fluctuations. You would just want to put in some solid validation to ensure there isnt an issue with your base record.
When we image surveys, they get sent to me as multi-line fixed length records. The cobol copybook refuses to perish.