Job Description

TCS is hiring for a PostgreSQL-focused data engineering role requiring 7+ years of experience. This position involves end-to-end ownership of data ingestion, transformation, orchestration, and performance tuning for batch and near real-time workflows on Google Cloud Platform (GCP). Key responsibilities include developing and maintaining robust data pipelines using Airflow, optimizing BigQuery and Dataproc performance, implementing data governance and security measures, and integrating with BI tools. Candidates must demonstrate strong proficiency in cloud infrastructure, containerization, and CI/CD practices.

Required Qualifications

GCP Services (BigQuery, Cloud Storage, Dataproc, Cloud Composer)
Strong Apache Airflow expertise (DAG creation, operators, scheduling, backfilling, retry strategies, CI/CD)
PostgreSQL Programming (Tables, Triggers, Views, Stored Procedures)
Python and PySpark
Advanced BigQuery SQL
Dimensional Modeling (Star/Snowflake) & Schema Design
BigQuery Partitioning/Clustering & Dataproc Executor Tuning
Git & CI/CD Pipelines for DAG Deployment
Cloud Logging & Pipeline Debugging
Pub/Sub & Dataflow (Apache Beam)
Event-Driven Orchestration & Dependency Management
Data Governance (PII Handling, Row-Level Security, Encryption)
Docker & Terraform for GCP IaC
Google Professional Data Engineer Certification

Preferred Qualifications

Experience with Looker, Tableau, or Power BI
Advanced Kubernetes Concepts
Data Vault Methodology
Cross-Environment Promotion Strategies
Root-Cause Analysis for Complex Pipeline Failures

Skills Required

PostgreSQLPythonPySparkApache AirflowGoogle Cloud PlatformBigQueryDataprocCloud ComposerTerraformDockerKubernetesGitApache BeamPub/SubAdvanced SQLData ModelingPerformance TuningCI/CDCloud LoggingBI Integration