Skip to main content

Data Engineer

Job Profile:

The AWS Data Engineer would need to have at least 3+ years of experience. The AWS data engineer possesses 3+ years of experience developing and architecting with AWS solutions and is responsible for the development of AWS solutions utilizing network, storage, operating systems, virtualization, RDBMS and NoSQL databases, Hadoop, mid-tier technologies that include application integration, in-memory caches, and security.

You must be well experienced in the AWS platform and a motivated technologist with a proven track record of delivering results in software/technology consulting.

Job Responsibilities:

    • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake.
    • Analyze, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.
    • Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala.
    • Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
    • Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.

Job Specifications:

    • At least 2-4 years of experience in “on premise to Cloud” migrations or IT transformations
    • Preferably, experience in Oracle and Snowflake Database
    • Well versed and hands on expertise in implementing AWS stack such as

-Serverless Architecture

-AWS RedShift modeling and performance tuning techniques

-Worked with Snowflake Data Warehouse

– Experience in migrating On-Prem relational databases to AWS Aurora, Redshift, Dynamo DB (or similar)

-Experience in implementing AWS Lambda Architecture, Elastic search.
-AWS and Data Platform experience with the following: Kinesis, Redshift, Glue, S3
-ETL Tools – Informatica, Talend, etc.

– Replication – Attunity Replicate, Golden Gate, etc.,

    • Proven experience of at least 3 years as a Data Engineer or similar role (preferably, in financial institution)
    • Bachelors Degree in Computer Science, Information Technology or other relevant field

Sub-K does not discriminate among candidates on grounds of gender, caste, religion, disability or sexual orientation

Job Type: Full Time
Job Location: Hyderabad

Apply for this position

Allowed Type(s): .pdf, .doc, .docx