Snowflake Developer and Python/SQL
Description
Job Title: Data Engineer / Snowflake Developer Position: SSE / LA Experience: 5+ years of experience Category: Software Development Job location: HYD/BLR Employment Type: Full Time / Permanent Qualification: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
Primary Responsibilities . Design, develop, and maintain data pipelines and ETL processes using Snowflake. . Write efficient SQL queries for data extraction, transformation, and loading. . Develop automation scripts and data processing workflows using Python. . Optimize data models and queries for performance and scalability in Snowflake. . Ensure data quality, integrity, and security across all processes. . Strong problem-solving and analytical skills. . Excellent communication and collaboration abilities.
Additional Responsibilities (Spark / Databricks) . Build and optimize distributed data processing pipelines using Apache Spark or Databricks. . Implement data transformations and aggregations for large-scale datasets. . Integrate Spark/Databricks workflows with Snowflake and other data sources. . Perform performance tuning and cluster resource optimization for big data jobs. . Develop notebooks and jobs in Databricks for advanced analytics and machine learning workflows. . Collaborate with data scientists and analysts to enable scalable data solutions.
Primary Skills . Snowflake: Advanced knowledge of Snowflake architecture, performance tuning, and best practices. . Python: Strong programming skills for data manipulation, automation, and integration. . SQL: Expertise in writing complex queries, stored procedures, and query optimization.
Secondary / Good-to-Have Skills . Spark or Databricks: Experience in distributed data processing and big data frameworks. . Familiarity with cloud platforms (AWS, Azure, or GCP) and related services. . Knowledge of CI/CD pipelines and version control (Git).
CGI is an equal opportunity employer. In addition, CGI is committed to providing accommodation for people with disabilities in accordance with provincial legislation. Please let us know if you require reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs.
#LI-GB9
Skills:
Apache Spark, English, Python, Snowflake, SQLite