Sr Data Engineer

Atlanta, GA 30319 | Direct Hire

Post Date: 03/01/2018 Job ID: 48790 Industry: Big Data
  • Gather and processes raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks.
  • Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.
  • Understand and enforce appropriate data master management techniques.
  • Ensure data quality and implement tools and frameworks for automating the identification of data quality issues.
  • Work with internal and external data providers on data validation, provide feedback, and make customized changes to data feeds and data mappings for analytical and operational use.
  • Understand the challenges that the analytics organization faces in their day-to-day work, and partner with them to design viable data solutions.
  • Recommend improvements to processes, technology, and interfaces that improve the effectiveness of the team and reduce technical debt.
  • Drive new and enhanced capabilities to our Enterprise Data Platform partners to meet the needs of product/engineering/business.
  • Provide ongoing support, monitoring, and maintenance of deployed products.
  • Work directly with stakeholders to understand real world problems in our domain.
  • Shape actionable items for the data services engineering team to solve those real-world problems.
  • Demonstrate ownership of initiatives and drive them through to completion.
  • Provide mentorship to the team.

Required Experience
  • Extensive experience engineering server-side code for data processing applications.
  • Working experience with Hadoop ecosystem technologies such as Hive or Pig.
  • Working experience with distributed scalable data stores such as Hbase, Accumulo, or BigTable.
  • Working experience with MapReduce-based frameworks.
  • Experience with data concepts (SQL, NoSQL, Normalization) and working with complex data structures.
  • Exposure to Agile/SAFE methodologies.
  • Git or general version control experience.
  • Professional experience with a statically-typed language (Java, Scala etc.) and a dynamically-typed language (Python, NodeJS, JavaScript etc.) and understand the tradeoffs of each.
  • Knowledge of functional programming.
  • Ability to understand and work with product teams to engineer requirements.
  • Analytical skills and the ability to pay careful attention to detail.
  • Technical writing including high and low level diagramming techniques.
  • MS/BS degree in Computer Science, related field, or equivalent work experience.

  • Experience with Data Modeling (strongly desired)
  • Spark
  • Experience with event frameworks (Kafka, Kinesis, RabbitMQ etc.)
  • Working experience of statistics and how they apply to operational metrics

Apply Online

Not ready to apply?

Send an email reminder to:

Share This Job:

Related Jobs: