Lead Software Engineer

Position: Lead Software Engineer

Job Overview:

Lead ETL Engineer with SSIS (SQL Server Integration Services) knowledge is primarily responsible for designing, developing, and maintaining ETL (Extract, Transform, Load) workflows and data integration processes to support enterprise data solutions.

Key Responsibilities and Duties

Lead the software development team:

- Lead a team of software engineers in designing, developing, and maintaining ETL Framework. - Set and communicate clear expectations for the clients regarding project timelines, quality standards, and deliverables. - Experience with Microsoft SQL Server Database, - Hands-on experience in writing, optimizing and maintaining complex SQL queries, stored procedures and functions. - Design and develop robust, scalable, and efficient database structures based on the organization's requirements.

SSIS:

- Design, develop, test, deploy, and maintain SSIS packages for data migration, ETL processes, reporting and to integrate data between various systems. - Develop complex SQL queries to extract data from various sources such as Oracle or SQL databases. - Troubleshoot issues related to package execution failures and optimize performance of existing packages. - Collaborate with stakeholders to understand business requirements and design solutions using SQL Server Integration Services (SSIS). - Work closely with the team to ensure timely delivery of projects. - Optimize existing integrations for improved performance and scalability. - Design and implement complex SSIS packages for extracting, transforming, and loading data from various sources such as relational databases (SQL Server, Oracle, DB2), flat files, and XML files. - Develop ETL best practices, including error handling, logging, checkpoints, and data quality assurance. - Write efficient SQL queries, stored procedures, functions, and triggers to support ETL processes. - Optimize SSIS packages and SQL queries for maximum performance using techniques such as parallelization, lookup caching, and bulk loading. - Create and maintain design documentation such as data models, mapping documents, data flow diagrams, and architecture diagrams. - Collaborate with business analysts, BI teams, and other stakeholders to understand requirements and deliver data solutions for reporting and analytics. - Schedule and monitor SSIS workflows using SQL Server Agent or other scheduling tools, ensuring timely and error-free data loads. - Troubleshoot, debug, and test SSIS packages and backend database processes to ensure data accuracy and system reliability. - Participate in resource planning, task estimation, and code review processes.

Collaborate with cross-functional teams:

- Work with other teams such as product management, quality assurance, and user experience to ensure that software applications meet business requirements and user needs. - Communicate effectively with team members and stakeholders.

Stay up to date with emerging trends and technologies:

- Keep up to date with emerging trends and technologies in the software development industry. - Make recommendations for improvements to existing software applications and processes.

Mandatory skills

SSIS, understanding of ETL Framework, able to design and implement SSIS

Qualifications

- Bachelor’s degree in computer science or related field. - 6-9 years of experience in software development. - Proven leadership experience in leading ETL teams. - Knowledge of software development methodologies such as Agile or Scrum. - Ability to mentor and train junior team members.