MountainViewRecruiter Since 2001
the smart solution for Mountain View jobs

Big Data Tools, Data Analytics Pipeline Framework Engineer

Company: OSI Engineering
Location: Mountain View
Posted on: October 18, 2020

Job Description:



We are looking for a savvy Data Frameworks Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Frameworks Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company's data architecture to support our next generation of products and data initiatives.

Must Have Skillset:

--- Solid Experience with big data tools: Hadoop, Spark, Kafka, etc.

--- Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

--- Experience with data pipeline and workflow management tools: Airflow.

--- Experience with AWS cloud services: EC2, EMR Experience with Vertica Experience with stream-processing systems: Storm, Spark-Streaming, etc.

--- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

--- Experience building and optimizing 'big data' data pipelines, architectures and data sets.

--- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

--- Strong analytic skills related to working with unstructured datasets.

--- Build processes supporting data transformation, data structures, metadata, dependency and workload management.

--- A successful history of manipulating, processing and extracting value from large disconnected datasets.

--- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.

--- Strong project management and organizational skills.

--- Experience supporting and working with cross-functional teams in a dynamic environment.

--- We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science.


--- Create and maintain data pipeline frameworks with the optimal architecture, Assemble large, complex data sets that meet functional / non-functional business requirements.

--- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

--- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.

--- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

--- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

--- Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.

--- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

--- Work with data and analytics experts to strive for greater functionality in our data systems.


Tony Do

408-550-2800 x 115


Keywords: OSI Engineering, Mountain View , Big Data Tools, Data Analytics Pipeline Framework Engineer, Engineering , Mountain View, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Other Engineering Jobs

Driver - Clinical Service Technician
Description: br br Job Summary br With over 300 locations across the US, Apria Healthcare's mission is to improve the quality of life for our 1.8 million patients at home by providing home respiratory services (more...)
Company: Apria Healthcare
Location: Sacramento
Posted on: 10/23/2020

Civil Engineer - Designer - CAD Technician - Project Manager
Description: ATTENTION SACRAMENTO AREA CIVIL ENGINEERING LAND DEVELOPMENT INDUSTRY PROFESSIONALS: TJG Civil Engineering, Planning, and Survey is actively seeking skilled and experienced Civil Engineers, Civil CAD (more...)
Company: TJG Civil Engineers and Land Planners
Location: Rancho Cordova
Posted on: 10/23/2020

Hardware Engineer PhD (Intern) - United States
Description: What You'll Do br br Impact the product development from the lowest levels of circuit design to large system design and see your contribution
Company: Cisco
Location: San Jose
Posted on: 10/23/2020

Project Manager -
Description: Excellent opportunity for an experienced Project Manager who will be responsible for leading project teams and managing all activities in a project life-cycle initiation planning, executing/
Location: San Francisco
Posted on: 10/22/2020

Description: I'm looking to hire a good mechanic with diagnostic skills. Preferably 5 or more years experience. The
Company: Planet Auto Inc.
Location: San Francisco
Posted on: 10/23/2020

Project Coordinator - Healthcare - Career Path! $$$
Description: Fantastic Opportunity for an experienced Project Coordinator Come join the team br br Well known organization is seeking an experienced Project Coordinator to join their team. This is an amazing (more...)
Location: Sacramento
Posted on: 10/22/2020

Project Manager - Direct Hire - High Profile Position
Description: This Project Manager - Direct Hire Position Features: br High Profile Position br Major Construction Projects br Great Pay And Bonus Structure
Location: Hercules
Posted on: 10/22/2020

IT Engineer (Intern) - United States
Description: IT ENGINEER br br IT has never been more important to Cisco and our communities. We provide the technological infrastructure and capabilities that support our employees, customers, and partners to (more...)
Company: Cisco
Location: San Jose
Posted on: 10/23/2020

Associate Rotation Engineer - Analog Mixed Signal (AMS) (224312) - SISW - Mentor
Description: br Starting Date for this position: Summer 2021-- br br In this position, you will be involved in a structured Associate Rotation Engineer Training Program. This is a fast-track paid training program (more...)
Company: Mentor Graphics
Location: Fremont
Posted on: 10/23/2020

Professional Services Engineer
Company: Fortinet
Location: Sunnyvale
Posted on: 10/23/2020

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

Mountain View RSS job feeds