We are seeking a highly motivated and experienced Lead/Senior Data Engineer to join our growing team. In this leadership role, you will be responsible for designing, developing, and implementing robust and scalable data solutions. You will lead a team of data engineers, mentor junior members, and play a key role in driving data-driven decisions across the organization.
Key Responsibilities:
- Data Engineering:
- Lead the design, development, and implementation of data pipelines and ETL processes to extract, transform, and load data from various sources (e.g., databases, APIs, cloud platforms) into data warehouses and data lakes.
- Develop and implement data quality checks and validation procedures to ensure data accuracy and integrity.
- Build and maintain data models and schemas for optimal data storage and retrieval.
- Collaborate with data scientists and analysts to support data exploration, analysis, and modeling.
- Automate data processes to improve efficiency and reduce manual effort.
- Team Leadership:
- Lead and mentor a team of data engineers.
- Assign tasks, provide guidance, and ensure project deadlines are met.
- Foster a collaborative and productive team environment.
- Conduct performance reviews and provide constructive feedback.
- Technical Leadership:
- Stay abreast of the latest data engineering technologies and best practices.
- Evaluate and recommend new technologies and tools to improve data infrastructure and processes.
- Contribute to the development and improvement of data engineering standards and best practices within the organization.
Required Skills:
- Technical Skills:
- Strong proficiency in SQL and Python
- Extensive experience with PostgreSQL (including performance tuning and optimization)
- Experience with data warehousing and data lake technologies (e.g., Snowflake, AWS Redshift, Azure Data Lake)
- Experience with cloud platforms (e.g., AWS – a strong plus)
- Experience with ETL/ELT tools (e.g., Apache Airflow, dbt, Matillion)
- Experience with data visualization tools (e.g., Tableau, Power BI)
- Knowledge of data modeling techniques (e.g., star schema, snowflake schema)
- Experience with Agile methodologies
- Leadership Skills:
- Strong leadership, mentorship, and communication skills
- Ability to motivate and inspire a team
- Excellent problem-solving and decision-making skills
- Ability to work effectively with cross-functional teams
- Strong organizational and time-management skills