I have built an ETL package which loads data from an excel 2010 (179 thousand records) to a table in a database (simple construction, direct loading).
In my work there are three environments (Development, Quality and Production), my construction in the development environment is fully loaded through Jobs (Package and configs) and at project level (Visual Studio 2013).
In the environment of quality, of the same characteristics as development and production, Job also bears the excel in its entirety; but in the production environment with the same characteristics of the two environments mentioned above does not load data from the excel and indicates the following error:
GESTION_WT_VC(Excel file name) / Detail (Sheet name) / Weight of the excel file: 31 MB approx / Number of records: 179 thousand records.
Discards made in the production environment:
- Change sheet with the same amount of data (same error).
- Reduce the amount of data to 50 thousand records (same error).
- The package contains flows 18 loads of excel with 2 thousand records approx. each and it is loaded satisfactorily except for
GESTION_WT_VC(It is the heaviest excel).
The last thing I did with the excel file was to reduce the data to 5000 records and the Job was executed, obtaining a positive load response.
I do not know what could be happening in the production environment that does not allow loading the excel file with 179 thousand records. I remain attentive to your comments, thank you.