Software/ Big Data Engineer

This is a Full-Time Direct Hire position and at this time our client is not providing sponsorship, a candidate must be eligible to work in the US with no sponsorship required presently or in the future.
Our client is hiring a Software/ Big Data Engineer to focus on data and work on various data initiatives, including building performance reporting and AI/Client-based features into the platform. The ideal candidate is an experienced software engineer who is also experienced in building data pipelines, wrangling data, and has a strong interest in building data products from the ground up.
Summary: The platform operates on a microservice architecture and new features will be built that leverage advanced data modeling, Client, and AI (both home-grown and off-the-shelf). ?At its core is a set of relational databases accessed by both Restful and GraphQL API endpoints, in turn powering 40+ applications written in a range of languages including Python, Go, React, and PHP. ?The successful candidate will play a key role in the development of custom data models, algorithms, pipelines, and APIs to support these features.
  • Participate in key software design, working directly with other engineers, the product team, DevOps, and the editorial team.
  • Architect, write code, complete programming and perform testing and debugging of data applications.
  • Build data APIs and data delivery services that support critical operational and analytical applications for our internal business operations, customers and partners.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
  • 3+years?experience with Software Engineering
  • 2+ years experience with relational databases (Postgres preferred)
  • 2+ years experience with Node.js
  • Experience/familiarity with Python
  • Ability to take a feature or service to full completion, from working with back-end tech through front-end implementation
  • Expert SQL knowledge and experience working with relational databases and query authoring.
  • Experience building/optimizing 'big data' data pipelines, architectures and datasets.
  • Knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Strong analytic skills related to working with unstructured datasets.
  • Ability to work in Agile/Scrum.
  • B.S./M.S. in Computer Science or a related field, or equivalent experience.
Highly desirable experience/familiarity:
  • Keen interest in software bots and AI
  • Stream-processing systems: Storm, Spark-Streaming, etc.?
  • BI tools: Looker, Domo, Tableau, etc.
  • GCP cloud services: BigQuery, Cloud Storage, etc.
  • AWS cloud services: EC2, EMR, RDS, Redshift
  • Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Big data tools: Hadoop, Spark, Kafka, etc.
  • Botkit library for Slack


Don't Be Fooled

The fraudster will send a check to the victim who has accepted a job. The check can be for multiple reasons such as signing bonus, supplies, etc. The victim will be instructed to deposit the check and use the money for any of these reasons and then instructed to send the remaining funds to the fraudster. The check will bounce and the victim is left responsible.

More Jobs

Big Data Engineer
Pittsburgh, PA EPAM Systems Inc
Associate, Cloud Big Data Engineer
Philadelphia, PA KPMG
Lead/Sr. Big Data Engineer /Assoc IT Architect...
Plymouth Meeting, PA IQVIA
Associate, Cloud Big Data Engineer
Wayne, PA KPMG
Java Engineer (Big Data Engineer)
Danville, PA ChaTeck Incorporated