Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Databricks Unified Data Analytics Platform
Good to have skills : AI Agents & Workflow Integration
Minimum 3 Year(s) Of Experience Is Required
Educational Qualification : 15 years full time education
Summary:
As a Data Engineer, your typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. You will be responsible for creating efficient data pipelines that facilitate smooth data flow and ensure high data quality. Your role includes implementing extract, transform, and load processes to migrate and deploy data seamlessly across various systems, enabling reliable and scalable data infrastructure to support organizational needs.
Roles & Responsibilities:
Expected to perform independently and become an SME. Required active participation/contribution in team discussions. Contribute in providing solutions to work related problems. Collaborate with cross-functional teams to understand data requirements and deliver appropriate solutions. Monitor and optimize data workflows to improve performance and reliability. Document data processes and maintain clear communication with stakeholders. Support junior team members by sharing knowledge and assisting with technical challenges.
Professional & Technical Skills:
Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform, AI Agents & Workflow Integration. Good To Have Skills: Experience with AI Agents & Workflow Integration. Strong knowledge of data pipeline architecture and best practices for data ingestion and transformation. Experience with cloud-based data platforms and scalable data processing frameworks. Ability to troubleshoot and resolve data quality issues effectively. Familiarity with scripting and automation to streamline data operations.
Additional Information:
The candidate should have minimum 3 years of experience in Databricks Unified Data Analytics Platform. This position is based at our Hyderabad office. A 15 years full time education is required.
Required Qualifications
Databricks Unified Data Analytics Platform expertise
3+ years of experience in data engineering
Preferred Qualifications
AI Agents & Workflow Integration expertise
Experience with cloud-based data platforms
Scripting and automation proficiency
Skills Required
Databricks Unified Data Analytics PlatformData pipeline architectureETL processesCloud-based data platformsData quality assuranceScriptingAutomationProblem-solvingCollaborationCommunication