Data Engineer

Hi Folks!

We are hiring Data professionals!

Note: Only Pune based candidates or those who are currently staying in Pune are requested to apply as final round includes candidate to appear for F2F discussion.

Role: AWS Data Engineer

Location: Pune

Experience: 4- 6 Yrs.

Company’s Website: http://www.yash.com/

Skillset: AWS + Python + Pyspark + SQL

Primary Skillsets:

AWS services (EC2, Lambda, Athena, Step function), build ETL/ELT workflows using Python, PySpark scripting, SQL, AWS Databricks

Secondary Skillsets: React; Database; GitHub Actions; Terraform. Also, should have worked in an Agile environment (User Stories/Features and following all Agile Rituals/meetings).

Responsibilities: Job description-

1. Design, develop, and maintain scalable data pipelines using AWS services, including EC2, Lambda, Step Function, and Athena

2. Maintain EC2 instances with auto-scaling policies, implement and manage IAM roles, policies, and security in the AWS application

3. Strong in Python scripting, list comprehensions and generators, String manipulation and formatting, Data structures (lists, dictionaries, sets, tuples), File I/O operations and various exception handling scenarios

4. AWS Lambda: Function development, event-driven architecture, different trigger types (S3, DynamoDB, API Gateway, EventBridge, SQS, SNS, CloudWatch)

5. AWS Step Functions is like Workflow orchestration, state machines, and error handling. Also strong in EC2 Instance types, auto-scaling groups, launch configurations/templates, scaling policies (target tracking, step scaling, scheduled)

6. Worked with AWS Databricks to build and maintain data lake house architectures, notebook pipeline execution, optimization, troubleshoot and resolve data pipeline issues.

Regards,

Jaspreet