Big Data - Software Engineer

Company: Flexton, Inc.
Location: Mountain View
Posted on: January 26, 2023

Job Description:

Skill: Description:We are seeking for an accomplished, enthusiastic Big Data Engineer to join the Client's eCommerce team. This exciting position involves many key engineering challenges as we deal with huge data sets (Billions of Transactions and Petabytes of data) to impact real-time customer activities.Responsibilities and scope of this role include:- Build scalable, high- performance, and efficient pipelines and workflows that are capable of processing billions of transactions and real-time customer activities.- Work with big data and provide to our data scientists the right tools, data marts and rollups to build their machine learning models.- Fluent in Pig and/or Hive with experience in building UDFs, Pig and Hadoop streaming.- Build automated reports that can help the team to proactively identify quality and/or coverage problems in releases or new versions of our models.- Apply knowledge of Azkaban, Oozie or Hamake for workflow management and job scheduling.- Work on Data Warehousing architecture and data modeling best practices.Qualifications- A Master of Science degree or equivalent in Computer Science, Computer Engineering, Electrical Engineering or related field plus 1+ years of software engineering experience; OR a Bachelor of Science degree with 5 years of software engineering experience.- Must have demonstrable, programming proficiency in at least one of the following: Java, C/C++, or Python.- Deep understanding of Map Reduce framework & Hadoop.- Fluent in Pig and/or Hive with experience in building UDFs, strong scripting ability.- Expert understanding of ETL techniques.- Knowledge of Azkaban, Oozie or Hamake for workflow management and job scheduling.- Must be team oriented and collaborative to interact with both managers and cross functional teams.- Ability to thrive in a fast paced environment on multiple projects in various phases and under tight deadlines

Keywords: Flexton, Inc., Mountain View , Big Data - Software Engineer, IT / Software / Systems , Mountain View, California