Job Description
The Sr. Data Integration & ETL Developer will be responsible for transforming incoming Broker, Client, and related files into accepted Copper Hill formats. This role involves developing and maintaining both current and future extract processes to send data efficiently and securely to Brokers, Clients, and various stakeholders. Lead and mentor the ETL development team, providing technical guidance and support to ensure best practices are followed. Communicate project status, risks, and progress to leadership, fostering clear alignment with organizational goals.
Essential Duties & Responsibilities
- Use or develop tools to process incoming files and data streams.
- Normalize external data into Copper Hill formats.
- Ensure data integrity, security, and compliance during transformation and transfer.
- Automate workflows with Azure Data Factory or other ETL tools, including error handling and alerts.
- Document transformation rules, file formats, and processes.
- Develop unit and integration tests for ETL and data transformations.
- Optimize SQL queries and ETL pipelines for high-volume performance.
- Implement data encryption and follow compliance and security standards.
Qualifications
- Proficiency in SQL for data querying and manipulation.
- Experience with ETL processes, especially in Azure Data Factory for pipeline orchestration and automation.
- Programming skills in C# and/or Python for custom logic and integration.
- Knowledge of XML for data formatting and transformation.
- Experience in API development and integration.
- Understanding data security practices, including encryption and compliance standards.
- Ability to create clear documentation and establish testing frameworks for ETL and transformation logic.
Additional Information
The ideal candidate will have a collaborative mindset, excellent communication skills, and a drive for continuous improvement. This position offers opportunities to work with cutting-edge data technologies and contributes to scalable, secure, and efficient data processes across the organization.
