Senior Data Engineer
Description
Project Overview The company helps hotel chains like Hilton and Marriott transform front-desk staff into revenue generators through upselling training and analytics. Their IN-Gauge SaaS platform empowers frontline teams across 2,000+ properties in over 100 countries.
Responsibilities
- Implement scaling of the case detection process (scanner)
- Split API into multiple API services
- Emulate pubsub/cloud run locally
- Implement scaling of the case detection process (scanner)
- Split API into multiple API services
- Emulate pubsub/cloud run locally
- Extract & process data using PySpark + S3 (Kafka/Kinesis — bonus)
- Write & optimize SQL on PostgreSQL/Redshift; use DynamoDB as data source/sink
- Run and debug ETL jobs on Glue or EMR; monitor via console/Spark UI
Requirements (Must-have) Data engineering - 5 years, AWS - 3 years (1 year latest project), Spark/PySpark - 2 years (1 year latest project)
Nice to Have GCP (pubsub/Cloud Run)
Hiring Process Intro call Technical discussion (focused on real experience) Offer Start: ASAP
Skills
SQLRedshiftAPIPostgreSQLDynamoDBGCPAWSETLApache SparkKafkaData EngineeringSpark
Want AI to find more roles like this?
Upload your CV once. Get matched to relevant assignments automatically.