Verticalmove
Apply Now »

Data Engineer Manager (BI) - Data Science/AI/Machine Learning


« Back to results

Michelle Rogers Division Director Phoenix

Phone Work
Phone Fax
Email: michelle.rogers@verticalmovecom.onmicrosoft.com



Job Info



Category Data Science/AI/Machine Learning
Employment Type Full-Time Employment
Compensation $0.00 - $0.00
Location United States, CA - 94107


Client Introduction



This client is modern, in the public cloud (AWS), micro-services based large distributed system and is quality driven. Their stack consists of Scala, Play, Akka, MongoDB, PostgreSQL, Docker, Mesos, Marathon, Jenkins, Kafka, Spark, HDFS etc. They believe in continuously evaluating our tech stack, have an easy process of suggesting and adapting new technologies. Our engineers enjoy being empowered and accountable.

Job Description



As an integral member of our team, the Principal Business Intelligence ETL Developer would be responsible for the design, development, implementation, and support of critical enterprise E2E Business Intelligence ETL solutions in Hadoop, sourcing data from HDFS, Amazon Redshift, MongoDB or Postgres environments and utilizing Python, Spark, and Hive.

Job Responsibilities



You will handle the product's or project’s conception, design initial product specifications and lead scheduling, estimating and securing of resources, as well as provide technical guidance to other internal and external teams; help to train new employees and stay ahead of industry trends and issues.

Experience



Understanding of various data extraction and transformation techniques with data sourced in HDFS, MongoDB, and Postgres Working familiarity with Pentaho, Airflow, or Oozie
Knowledge of Scala is a bonus
Familiar with Data Visualization standard methodologies

Soft Skills
Ability to succeed in a dynamic, Agile environment
Strong prioritization and time-management skills
Dedication to team goals that include support of live 24/7 production systems
A consummate collaborator, able to establish good relationships with technical, product, and business owners
A champion of quality, able to QA and vouch for the integrity of the report output
Maintaining business partner engagement and setting expectations
Assessing current processes and recommending changes as needed
Documenting and communicating technical specifications to ensure that proper and optimized techniques, queries, data standards, and final outputs are understood and incorporated into data and analytics processes
Participate in business analysis activities to gather required reporting and dashboard requirements
Translate business requirements into specifications that will be used to implement the required user-friendly environments, reports and dashboards, built from potentially multiple data sources


Required Experience



Advanced working knowledge and ability to write complex SQL and HQL queries in an HDFS environment Extensive hands-on experience working with Python and PySpark for the purposes of data transformations and ETL Strong familiarity with Kimball, OLAP, and EDW data design methodologies
8+ years experience in ETL, Data Engineering, or BI fields with concentration on data transformations


Required Education





Previous MonthNext Month
SunMonTueWedThuFriSat