Write a program to load my IIS web log file (WC3 format) into a MS SQL table.  Log files are stored on a monthly basis.  The log files can have different fields logged.  Program will identify header record fields available.  Read the log file records.  Determine if the records already exist in db and then load them in.



I want to run this via an SSIS package.  Programmed in VB .NET.



I want to run this program every night and pull in all the new log records.  I have tried Microsoft ODBC tools for custom SQL db import of log files.  But I really don't like it.



I expect this to be a quick project.