Apache Spark Engineer


  • Data Science

  • SQL

  • Machine Learning

  • Scala.js

  • Hadoop

  • Cloud Computing

  • Sparc

  • Python

  • Javascript

  • R

  • Big Data

  • C++

  • D3.js

Read More

  • Job Posted: Tuesday, March 17, 2015

  • Expires On: Friday, September 18, 2015

  • Job Type: Permanent

  • Desired Salary: $220000.00/yr

  • Work Authorization: Citizen

Have been doing Spark development since February, 2013, and have been mentoring Spark (including on YouTube) since April, 2013. I'm the author of the upcoming book, Spark GraphX In Action, due later in 2015.
  • Pasadena, CA

  • Denver, CO

Senior Software Engineer @ (HIDDEN)

3/1/2014 - Current

Role Description

Developing knowledge engine and front end for Oracle Data Enrichment Cloud Service, which was first demonstrated at Oracle OpenWorld 2014. A cloud-based semantic-aware data transformation app that uses Spark and Hadoop on the back-end for online processing of user files.1. Prototyped Knowledge Graph on Spark/GraphX, to semantically discover, enrich and standardize user data against the knowledge in the knowledge graph2. Applied machine learning (Word2Vec, K-Means, Statistical Natural Language Processing) to improve knowledge engine results for discovery and standardization.3. Developed UX for richly interactive core page (jQuery, REST, etc.). Adapted for touch/iPad.4. Developed interactive visualizations in d3.jsProcess tools include Git, Maven, Hudson, Jira, and Beehive WikiDemo at https://www.youtube.com/watch?v=cJ6PhO0NZWU


Learn More