Role
Data Engineer
Location
United States, India
Experience
8+ years
Location Type
Remote
Team
Consulting Team
Data Engineer
United States, India – Experience 8+ years
Job Description
We are in search of a proficient Data Engineer with 8+ years of experience to join our innovative team. The chosen candidate will lead the conceptualization, design, and deployment of our data solutions tailored to meet our clients’ unique business requirements. This role involves significant collaboration with data scientists, architects, and other stakeholders to ensure the integrity and efficiency of our data systems.
Key Responsibilities
- Business Needs Assessment: Evaluate business needs and objectives to design appropriate data solutions.
- Data Organization: Intelligently design and organize the structure for raw data.
- Data Integration: Combine raw information from various sources to create comprehensive data sets.
- Data Preparation: Prepare data for prescriptive and predictive modeling.
- Data Systems and Pipelines: Build and maintain robust data systems and pipelines to ensure seamless data flow.
- Algorithm and Prototype Development: Build algorithms and prototypes to enhance data processing capabilities.
- Data Quality Enhancement: Explore and implement ways to improve data quality and reliability.
- Data Acquisition Opportunities: Identify opportunities for new data acquisition to enhance analytics capabilities.
- Data Analysis: Conduct complex data analyses and report key findings and actionable insights to various stakeholders.
- Trend Interpretation: Interpret trends and patterns to support business decision-making.
- Analytical Tool Development: Develop analytical tools and programs to support data-driven decision-making.
- Collaboration: Collaborate with data scientists and architects on multiple projects to ensure the success of data initiatives.
- Stakeholder Communication: Clearly articulate, summarize, and present important insights and key takeaways to internal and external stakeholders.
- Team Development: Develop team members with constructive support, feedback, and coaching.
Qualifications
- Degree in Computer Science, IT, or a related field; a Master’s degree and additional data engineer certifications are a plus.
- 8+ years of previous experience as a data engineer or in a similar role.
- Proven expertise with data models, data mining, and segmentation techniques.
- Hands-on experience with SQL database design.
- Proficiency in programming languages such as Java, Python, and SQL.
- Proficiency in databases like Oracle, SQL Server, MySQL,and PostgreSQL for structured data.
- Proficiency in Snowflake, Azure Synapse Analytics, and Amazon Redshift.
- Expert knowledge of Azure Data Factory, Apache Airflow, Blob storage, ADLS, Azure function apps, Azure logic apps, and Azure DevOps for CI/CD.
- Solid understanding of Data Warehouse concepts and Dimensional Modeling.
- Must have experience implementing data quality frameworks and tools, security practices (data encryption, access controls, compliance, etc.).
- Should have a good understanding of version control using GitHub.
- Proficient knowledge of using data visualization tools, such as Power BI.
- Good understanding of Machine Learning and AI frameworks.
- Strong numerical and analytical skills.
- Exceptional communication and client management skills.
- Ability to provide three or more professional references upon request.
