Apply Now »

Big Data Platform Architect /ETL - Big Data/NoSQL

« Back to results

Jim Beatrice Principal Recruiter

Phone Work +1 (415) 702-4555
Phone Fax

Job Info

Category Big Data/NoSQL
Employment Type Contract or Full-Time
Compensation $145000.00 - $185000.00
Location United States, CA - 95113

Client Introduction

Our client provides an affordable on-demand sales compensation solution allowing companies to improve their business performance through the use of more effective sales compensation programs. They enable companies to design, implement, manage, audit and communicate sales compensation programs. By providing more effective plans and better visibility, these companies can dramatically improve sales performance.

With clients that include Ariba, AOL, American Express, Akamai, Bank of America, Blackboard, Concur, Cascade, DHL, DocuSign DemandTec,, Genius, Honeywell, Informatica, John Hancock, Lexis-Nexis, Linkedin, Motorola, NBC, NTT, Opsource, Paypal, RiverBed,, Siemens, SuccessFactors, Twitter, Taleo, Tibco, Walgreens, Workday, Yamaha, Zendesk and Zuora to name a few their solution is being implemented over a vast variety of companies. And the list keeps growing.

Job Description

As a key member of the engineering team, you will lead the design, implementation and evolution of the data platform and data services in support of our SaaS and services solutions.

You’ll bring to the role a passion for building data platforms and data pipelines that are flexible, extensible, highly scalable, robust, and of course high performance. You must be driven, with an entrepreneurial spirit. The ideal candidate will be proficient and proven in the design and implementation of a scalable data platform that uses a mix of transactional relational database source systems in conjunction with BigData, Hadoop and NoSQL technologies, as underpinnings of the data platform and data services. You will bring your battle proven experience in data platforms of a SaaS, Cloud Analytics, consumer destination site, or Ad targeting platform to the team.

As a hands-on architect you will own and directly contribute to the design, implementation, evaluation, selection, and support of data technologies, data platform architecture and data platform services. You will serve as the lead architect for our big data platform ingesting billions of transactions and providing data platform services to a variety of internal software consumers of the data pipeline including data science, search, and analytics products.

Working in an agile environment, you will collaborate with product managers, peer architects, software engineers, QA engineers, and data center operations engineers.

Job Responsibilities

-Work closely with product management, architects, application and analytics engineers and the data science team to define and refine the big data platform to achieve company product and business objectives
-Design and develop new components of our big data platform in a multi-tenant SaaS environment
-Develop data platform services including API’s, data conventions, governance and security
-Collaborate with other technology teams and architects to define and develop cross-function technology stack interactions
-Research and experiment with emerging technologies and tools related to big data



-Production experience with the MapR Hadoop distribution
-Previous experience working with large data sets to create near real-time analytics
-Previous experience working collaboratively with data scientists
-Familiarity with Python and other server side scripting languages
-Familiarity and experience with agile development process
-Experience in both small and large companies

Required Experience

-At least 6 years commercial experience including 2-years as a hands-on contributing data platform architect, data or analytics architect or platform architect
-Experience using big data platforms and tools such as: Hadoop, Hive, HBase, Pig, Flume, Sqoop, Oozie, and NoSQL
-Strong server side Java development including Map-reduce
-Solid understanding of ETL Concepts
-Solid SQL skills and experience in an Oracle environment
-Solid traditional application, OLTP, and OLAP data modeling and data pipeline experience
-Team player with excellent communication and organizational skills
-Self-starter that is results focused with the ability to work independently and in teams
-Ability to balance tactical delivery with strategic vision to advance towards business-driven, time-critical objectives.
-Proven track record of producing high quality software against plans and schedules that are being met consistently

Required Education

-B.S. in Computer Science or other relevant technical field

Previous MonthNext Month