Big Data - Software Engineer
Company: Flexton, Inc.
Location: Mountain View
Posted on: January 26, 2023
|
|
Job Description:
Skill: Description:We are seeking for an accomplished,
enthusiastic Big Data Engineer to join the Client's eCommerce team.
This exciting position involves many key engineering challenges as
we deal with huge data sets (Billions of Transactions and Petabytes
of data) to impact real-time customer activities.Responsibilities
and scope of this role include:- Build scalable, high- performance,
and efficient pipelines and workflows that are capable of
processing billions of transactions and real-time customer
activities.- Work with big data and provide to our data scientists
the right tools, data marts and rollups to build their machine
learning models.- Fluent in Pig and/or Hive with experience in
building UDFs, Pig and Hadoop streaming.- Build automated reports
that can help the team to proactively identify quality and/or
coverage problems in releases or new versions of our models.- Apply
knowledge of Azkaban, Oozie or Hamake for workflow management and
job scheduling.- Work on Data Warehousing architecture and data
modeling best practices.Qualifications- A Master of Science degree
or equivalent in Computer Science, Computer Engineering, Electrical
Engineering or related field plus 1+ years of software engineering
experience; OR a Bachelor of Science degree with 5 years of
software engineering experience.- Must have demonstrable,
programming proficiency in at least one of the following: Java,
C/C++, or Python.- Deep understanding of Map Reduce framework &
Hadoop.- Fluent in Pig and/or Hive with experience in building
UDFs, strong scripting ability.- Expert understanding of ETL
techniques.- Knowledge of Azkaban, Oozie or Hamake for workflow
management and job scheduling.- Must be team oriented and
collaborative to interact with both managers and cross functional
teams.- Ability to thrive in a fast paced environment on multiple
projects in various phases and under tight deadlines
Keywords: Flexton, Inc., Mountain View , Big Data - Software Engineer, IT / Software / Systems , Mountain View, California
Click
here to apply!
|