Nov 29, 2021

Sr. Data Engineer, Data Platform

  • dv01
  • Remote
Full-Time Information Technology

Job Description

dv01 is lifting the curtain on the largest financial market in the world: structured finance. The $16+ trillion market is the backbone of everyday activities that empower financial freedom, from consolidating credit card debt and refinancing student loans, to buying a home and starting a small business.

dv01’s data analytics platform brings unparalleled transparency into investment performance and risk for lenders and Wall Street investors in structured products. As a data-first company, we wrangle critical loan data and build modern analytical tools that enable strategic decision-making for responsible lending.  In a nutshell, we're helping prevent a repeat of the 2008 global financial crisis by offering the data and tools required to make smarter, data-driven decisions resulting in a safer world for all of us. 

More than 400 of the largest financial institutions use dv01 for our coverage of over 75 million loans spanning mortgages, personal loans, auto, buy-now-pay-later programs, small business, and student loans. dv01 continues to expand coverage of new markets, adding loans monthly, and developing new technologies for the structured products universe.

To get a better idea of what a year at dv01 looks like, check out our 2020 Year in Review page here: https://dv01.co/year-in-review/2020/ If that looks like fun to you, get in touch because we'd love to hear from you.

YOU WILL:

  • Own our data platform. You will own the data platform that powers all of dv01’s customer offerings. Our platform code is written in Scala to get the maximum performance from Apache Spark. Our tech stack is built on the Google Cloud Platform, leveraging Apache Airflow, Apache Spark, BigQuery, CloudSQL, GKE, scheduling/monitoring tools, API crawlers, PDF parsers/scrapers, SFTP servers, and ad-hoc analysis services such as Databricks and RStudio.
  • Work extensively with open source technology. You’ll work heavily within the Spark ecosystem, as well as explore new open source technologies to solve customer needs. The skills you develop here will serve you well beyond dv01.
  • Interact with a diverse team. You will collaborate closely with other teams at dv01 to expand and improve the capabilities of our data platform. This includes working closely with the structuring team to resolve scaling or functionality pain points in data processing, the modeling team to build out a modern data science platform, and the frontend product engineering team to scale database queries to ship new products.
  • Gain knowledge of the financial industry. You’ll have an exclusive view into the system that enables Americans to afford houses, cars, and college. You will learn about the participants, terminology, and mathematics behind this sector of the financial markets.

Occupations

General-Other: IT-Software Development, Software-Web Development

States

AL, AK, AZ, AR, CA, CO, CT, DE, DC, FL, GA, GU, HI, ID, IL, IN, IA, KS, KY, LA, ME, MD, MA, MI, MN, MS, MO, MT, NE, NV, NH, NJ, NM, NY, NC, ND, OH, OK, OR, PA, PR, RI, SC, SD, TN, TX, UT, VT, VI, VA, WA, WV, WI, WY

Security Clearance

NO Security Clearance

Job Requirements

YOU ARE:

  • Experienced with all aspects of working with big data. You have 5+ years of professional data engineering experience working with large data sets and are intimately familiar with the construction of scalable ETL pipelines, intricacies of accurate data processing, and infrastructure involved with ensuring the reliability of hundreds of daily processes.
  • A Spark Enthusiast. You have at least three (3) years of professional programming experience with Apache Spark and a strong understanding of Spark internals and the operational complexities of managing a Spark cluster. You have engaged with the Spark community on mailing lists or on Github and may have contributed source code to the project.
  • A well-rounded engineer. You have 5+ years of professional programming experience with Scala or Java and a deep appreciation for engineering fundamentals. You understand the importance of writing tests, designing systems for long term maintainability, and evaluating both sides of common engineering considerations.
  • Enthusiastic about expanding your financial knowledge. You are excited to learn more about the intricacies of the financial system. You are adept at learning on the job and unafraid to dive into technical finance books.
  • Undergraduate or graduate degree in Finance, Math, or Engineering. Note that we’re not anti-dropouts if you’re a superstar.

Apply Now