Job Profile:
The AWS Data Engineer would need to have at least 3+ years of experience. The AWS data engineer possesses 3+ years of experience developing and architecting with AWS solutions and is responsible for the development of AWS solutions utilizing network, storage, operating systems, virtualization, RDBMS and NoSQL databases, Hadoop, mid-tier technologies that include application integration, in-memory caches, and security.
You must be well experienced in the AWS platform and a motivated technologist with a proven track record of delivering results in software/technology consulting.
Job Responsibilities:
-
- Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake.
- Analyze, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala.
- Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
- Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
Job Specifications:
-
- At least 2-4 years of experience in “on premise to Cloud” migrations or IT transformations
- Preferably, experience in Oracle and Snowflake Database
- Well versed and hands on expertise in implementing AWS stack such as
-Serverless Architecture
-AWS RedShift modeling and performance tuning techniques
-Worked with Snowflake Data Warehouse
– Experience in migrating On-Prem relational databases to AWS Aurora, Redshift, Dynamo DB (or similar)
-Experience in implementing AWS Lambda Architecture, Elastic search.
-AWS and Data Platform experience with the following: Kinesis, Redshift, Glue, S3
-ETL Tools – Informatica, Talend, etc.
– Replication – Attunity Replicate, Golden Gate, etc.,
-
- Proven experience of at least 3 years as a Data Engineer or similar role (preferably, in financial institution)
- Bachelors Degree in Computer Science, Information Technology or other relevant field
Sub-K does not discriminate among candidates on grounds of gender, caste, religion, disability or sexual orientation
