Title: Senior/Lead Data Engineer
Location: 100% Remote – PST Hours (8 AM – 5 PM PST) – Travel to Fremont, CA once every 2 Months for 3 Days (Expenses Paid)
Job Type: Contract – 12 Months
Key Skills: Sql, PySpark, Azure, Microsoft Fabric, ADF, and Databricks.
About the Role:
We are seeking a highly skilled and experienced Senior/Lead Data Engineer to join our dynamic team , working on challenging and multi-year data transformation projects. This is an excellent opportunity for a talented data engineer to play a key role in building innovative data solutions using Azure Native Services and related technologies. If you are passionate about working with large-scale data systems and enjoy solving complex engineering problems, this role is for you.
Key Responsibilities:
• Data Engineering : Design, development, and implementation of data pipelines and solutions using PySpark, SQL, and related technologies.
• Collaboration: Work closely with cross-functional teams to understand business requirements and translate them into robust data solutions.
• Data Warehousing: Design and implement data warehousing solutions, ensuring scalability, performance, and reliability.
• Continuous Learning: Stay up to date with modern technologies and trends in data engineering and apply them to improve our data platform.
• Mentorship: Provide guidance and mentorship to junior data engineers, ensuring best practices in coding, design, and development.
Must-Have Skills & Qualifications:
• Minimum 12+ years of overall experience in IT Industry.
• 8+ years of experience in data engineering, with a strong background in building large-scale data solutions.
• 4+ years of hands-on experience developing and implementing data pipelines using Azure stack experience (Azure, ADF, Databricks, Functions)
• 1-2 years of experience in Microsoft Fabric
• Some exposure/experience in SAP constructs
• Proven expertise in SQL for querying, manipulating, and analyzing large datasets.
• Strong knowledge of ETL processes and data warehousing fundamentals.
• Self-motivated and independent, with a “let’s get this done” mindset and the ability to thrive in a fast-paced and dynamic environment.
Good-to-Have Skills:
• Databricks Certification is a plus.
• Data Modeling, Azure Architect Certification