Note: The job is a remote job and is open to candidates in USA. Intellectt Inc is seeking a Big Data Architect/Data Pipeline Engineer. The role involves designing and building scalable data pipelines and big data architectures, while ensuring data quality, security, and governance standards.
Responsibilities
• Design and build scalable data pipelines and big data architectures
• Develop and optimize Databricks-based data solutions
• Implement data integration, processing, and storage solutions
• Ensure data quality, security, and governance standards
• Optimize solutions for performance, scalability, and cost
• Collaborate with stakeholders to translate business needs into technical solutions
Skills
• Databricks (Python, SQL, PySpark)
• Azure SQL Server (Managed Instance, Azure SQL DB, SQL Server VMs)
• Data Modeling and ETL/ELT design patterns
• Data Engineering (enterprise-scale)
• Performance tuning and scalability
• 7+ years of enterprise data engineering experience
• Strong experience with large-scale data pipelines and architectures
• Healthcare data integration experience is a must
• Data harmonization and normalization at scale
• Docker and Azure Kubernetes Service (AKS)
Company Overview
• We advance technology with purpose - empowering enterprises move confidently into the future. It was founded in 2018, and is headquartered in Iselin, New Jersey, USA, with a workforce of 1001-5000 employees. Its website is https://www.intellectt.com.
Apply Now
Apply Now