Senior Software Engineer - Data
Danti
Software Engineering
Remote
Posted on Tuesday, April 9, 2024
Company Overview
At Danti, we are building a search engine to enable users across the world to access all of the information being generated across our physical Earth. Sensing technologies like satellites, drones, 3D scanners etc. and various analytics continue to build information across the Earth, non-expert users are to this day unable to tap into the utility of these products due to being forced to use highly complex software. We are driven and aim to change that. The industry has finally advanced to where technologies are mature enough for us to bring this data to a much wider market in a simple, easy to understand way. Join us in enabling the future of how businesses, consumers and governments answer questions about what is happening across the physical world!
Our Mission
To make data across our planet searchable, discoverable and usable by anyone with a simple question to answer. We are focused on developing cutting edge technologies in the areas of data indexing, correlation and search so that you can search the Earth as you search the web.
Role Summary
We are rapidly integrating new data sources and are seeking a motivated Data Engineer to help own and scale our data platform. You will be working on enhancing the existing data pipeline to run more efficiently, defining data models, working with various spatial data (raster and vector), , deploying pipeline and application updates to the Cloud, defining infrastructure as code, and building and maintaining observability and monitoring into our data pipeline.
***Please Note: This role is REMOTE, with a preference for candidates to be local to Atlanta, Washington, DC, Miami, NYC, and the San Francisco Bay Area. We are unable to provide sponsorship.****
What you’ll do
● Design, build, and maintain efficient, reusable, and reliable ETL pipelines
● Define data models and mappings for newly integrated data
● Ensure data quality through the use of quality checks and validation
● Deploy pipeline and service updates using helm, flux and CDK to EKSMonitor, triage, and resolve any issues with data flow, data quality, or cluster scaling
● Collaborate with software engineers, product, and design to ensure alignment on data needs and deliverables
● Design, build, and maintain new interfaces and capabilities that are unlocked by new data integrations
What we are looking for
● 5+ years of experience developing software, with at least 3 years of experience working with data pipelines
● Experience building and scaling data pipelines (Airflow, or similar) with comprehensive testing and data quality checks
● Experience deploying IaC to the Cloud (AWS, GCP)
● Experience with OpenSearch or ElasticSearch
● Versed in Kubernetes management with k9s, kubectl, helm, and flux
● Proficiency in python and pydantic models
● Experience working with large quantities of data and/or geospatial data formats
● Ability to work in a distributed team with solid communication skills
● Strong customer focus
What will make you stand out
● Experienced deploying code with CDKExperience with GIS or working with customers who use GIS
● Experience building observability and monitoring into data pipelines
● Demonstrated ability to triage and resolve performance and scaling issues
What you get
● Competitive compensation, including company equity to ensure you can share in the success of your work
● Full health benefits
● A 401k Vehicle
● Opportunity to change how Individuals, Businesses, and Governments interact with Earth data
● Fun, collaborative work environment that is hybrid (remote / onsite) once a QTR, team building meeting for a week+
● Fast-paced startup environment
● Lots of personal responsibility, opportunities for growth and learning
What we can provide
● Competitive compensation, including company equity to ensure you can share in the success of your work
● Full health benefits
● A 401k Vehicle
● Opportunity to change how Individuals, Businesses, and Governments interact with Earth data
● Fun, collaborative work environment that is hybrid (remote / onsite)
● Fast paced startup environment
● Lots of personal responsibility, opportunities for growth and learning
This very exciting opportunity to join a new company at an early stage that will reward you with a ton of experience, positive collaborative team oriented culture, and significant equity stake in the company. If you value learning, developing products that have real impact on our world, and working with a positive collaborative time along the way then this is the place for you!
Visit us at https://danti.ai/