I'm running into an issue where I am not able to profile file data in Information Steward 4.0. I believe this is related to the fact that Data Insight is not returning any rows when I click view data for the specific file that I have loaded. However, I do not receive any error messages as to why the view data is not returning any records.
Here is what I'm doing:
- I've created a file format using the actual file I want to load to propose the schema
- I've adjusted some of the columns data structures in that proposed schema from int to varchar (I've also left these alone and my results are the same)
- I save schema
- Add file to the project using the schema
- Once file is loaded into the project,
- I select the file and view data -> Zero records returned
- Try to profile the data -> Failed due to the following message from the log:
Subtask [run id=1] Table WorkFiles on EDM03.DS-US-NewAdds.txt: Dataservices execution failed for (14.0) 01-18-13 13:10:06 (E) (5664:1364) FIL-080124: |Data flow DF_SPF_STATS_427_1|Transform PROFILE_SOURCE1__AL_ReadFileMT_Process The bad row limit for file <//server/WorkFiles/DS-US-NewAdds.txt> is met. The limit specified is <1>.. Error (14.0) 01-18-13 13:10:06 (E) (5664:1364) FIL-080124: |Data flow DF_SPF_STATS_427_1|Transform PROFILE_SOURCE1__AL_ReadFileMT_Process The bad row limit for file <//server/WorkFiles/DS-US-NewAdds.txt> is met. The limit specified is <1>. (COR-10690) (TSK-10008)
I suspect something is wrong with the schema, but I cannot pin point it. Any help would be appreciated.
Tom