Scorpion

Senior AI Data Engineer

USARemotePosted 10 days ago$155,000 – $185,000

Full TimeSeniorRemoteUS

See how this job matches your profile

Job Description

About Us Scorpion is the leading provider of technology and services helping local businesses thrive. We do this by helping customers understand local market dynamics, make the most of their marketing

Key Highlights

Evaluate and improve data quality, completeness, and consistency across 30+ databases, applications, platforms, and APIs.
Design and build Scorpion’s analytical data platform, creating a trusted source of truth for business and client data.
Develop and maintain scalable data pipelines that efficiently move data from operational systems into the analytical platform.
Help teams transition from querying production databases directly to using trusted analytical data sources.
Design data access patterns that enable AI agents and applications to quickly retrieve relevant client and business information.

Qualifications

Required Qualifications

Education Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related technical field, or equivalent practical experience.
Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related technical field, or equivalent practical experience.
Experience 7+ years of data engineering experience, including designing and operating production-scale analytical data platforms. Experience building scalable data pipelines, analytical systems, and data platforms in modern cloud environments. Experience integrating and unifying data from multiple systems into trusted, business-ready analytical platforms. Experience supporting data access and consumption patterns for applications, analytics, machine learning, or AI-powered solutions. Experience designing scalable data models that support analytics, reporting, and AI-driven applications. Experience establishing data governance standards, data contracts, and documentation practices across teams.
7+ years of data engineering experience, including designing and operating production-scale analytical data platforms.
Experience building scalable data pipelines, analytical systems, and data platforms in modern cloud environments.
Experience integrating and unifying data from multiple systems into trusted, business-ready analytical platforms.
Experience supporting data access and consumption patterns for applications, analytics, machine learning, or AI-powered solutions.
Experience designing scalable data models that support analytics, reporting, and AI-driven applications.
Experience establishing data governance standards, data contracts, and documentation practices across teams.
Technical Skills Data Processing & Lakehouse Technologies Deep expertise with Databricks, Delta Lake, and Apache Spark for large-scale data processing, streaming ingestion, and data transformation. Data Warehousing & Analytics Experience working with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies. Programming & Query Languages: Advanced SQL skills, including query optimization, execution planning, and performance tuning. Strong Python skills for data pipeline development, automation, transformation, and integration with production systems. Data Pipeline & Orchestration Tools Experience building and managing data pipelines using dbt, Airflow, Prefect, or similar orchestration and transformation tools. Architecture & Security Strong understanding of lakehouse architecture, data partitioning strategies, metadata management, and data security best practices.
Data Processing & Lakehouse Technologies Deep expertise with Databricks, Delta Lake, and Apache Spark for large-scale data processing, streaming ingestion, and data transformation.
Deep expertise with Databricks, Delta Lake, and Apache Spark for large-scale data processing, streaming ingestion, and data transformation.
Data Warehousing & Analytics Experience working with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies.
Experience working with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies.
Programming & Query Languages: Advanced SQL skills, including query optimization, execution planning, and performance tuning. Strong Python skills for data pipeline development, automation, transformation, and integration with production systems.
Advanced SQL skills, including query optimization, execution planning, and performance tuning.
Strong Python skills for data pipeline development, automation, transformation, and integration with production systems.
Data Pipeline & Orchestration Tools Experience building and managing data pipelines using dbt, Airflow, Prefect, or similar orchestration and transformation tools.
Experience building and managing data pipelines using dbt, Airflow, Prefect, or similar orchestration and transformation tools.
Architecture & Security Strong understanding of lakehouse architecture, data partitioning strategies, metadata management, and data security best practices.
Strong understanding of lakehouse architecture, data partitioning strategies, metadata management, and data security best practices.
Professional Skills Ability to collaborate effectively across engineering, product, data science, and business teams. Strong communication skills with the ability to translate business requirements into scalable data solutions. Strong analytical and problem-solving skills with a focus on building scalable, maintainable systems. Ability to balance long-term platform strategy with near-term business priorities.
Ability to collaborate effectively across engineering, product, data science, and business teams.
Strong communication skills with the ability to translate business requirements into scalable data solutions.
Strong analytical and problem-solving skills with a focus on building scalable, maintainable systems.
Ability to balance long-term platform strategy with near-term business priorities.
Education Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related technical field, or equivalent practical experience.
Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related technical field, or equivalent practical experience.
Experience 7+ years of data engineering experience, including designing and operating production-scale analytical data platforms. Experience building scalable data pipelines, analytical systems, and data platforms in modern cloud environments. Experience integrating and unifying data from multiple systems into trusted, business-ready analytical platforms. Experience supporting data access and consumption patterns for applications, analytics, machine learning, or AI-powered solutions. Experience designing scalable data models that support analytics, reporting, and AI-driven applications. Experience establishing data governance standards, data contracts, and documentation practices across teams.
7+ years of data engineering experience, including designing and operating production-scale analytical data platforms.
Experience building scalable data pipelines, analytical systems, and data platforms in modern cloud environments.
Experience integrating and unifying data from multiple systems into trusted, business-ready analytical platforms.
Experience supporting data access and consumption patterns for applications, analytics, machine learning, or AI-powered solutions.
Experience designing scalable data models that support analytics, reporting, and AI-driven applications.
Experience establishing data governance standards, data contracts, and documentation practices across teams.
Technical Skills Data Processing & Lakehouse Technologies Deep expertise with Databricks, Delta Lake, and Apache Spark for large-scale data processing, streaming ingestion, and data transformation. Data Warehousing & Analytics Experience working with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies. Programming & Query Languages: Advanced SQL skills, including query optimization, execution planning, and performance tuning. Strong Python skills for data pipeline development, automation, transformation, and integration with production systems. Data Pipeline & Orchestration Tools Experience building and managing data pipelines using dbt, Airflow, Prefect, or similar orchestration and transformation tools. Architecture & Security Strong understanding of lakehouse architecture, data partitioning strategies, metadata management, and data security best practices.
Data Processing & Lakehouse Technologies Deep expertise with Databricks, Delta Lake, and Apache Spark for large-scale data processing, streaming ingestion, and data transformation.
Deep expertise with Databricks, Delta Lake, and Apache Spark for large-scale data processing, streaming ingestion, and data transformation.
Data Warehousing & Analytics Experience working with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies.
Experience working with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies.
Programming & Query Languages: Advanced SQL skills, including query optimization, execution planning, and performance tuning. Strong Python skills for data pipeline development, automation, transformation, and integration with production systems.
Advanced SQL skills, including query optimization, execution planning, and performance tuning.
Strong Python skills for data pipeline development, automation, transformation, and integration with production systems.
Data Pipeline & Orchestration Tools Experience building and managing data pipelines using dbt, Airflow, Prefect, or similar orchestration and transformation tools.
Experience building and managing data pipelines using dbt, Airflow, Prefect, or similar orchestration and transformation tools.
Architecture & Security Strong understanding of lakehouse architecture, data partitioning strategies, metadata management, and data security best practices.
Strong understanding of lakehouse architecture, data partitioning strategies, metadata management, and data security best practices.
Professional Skills Ability to collaborate effectively across engineering, product, data science, and business teams. Strong communication skills with the ability to translate business requirements into scalable data solutions. Strong analytical and problem-solving skills with a focus on building scalable, maintainable systems. Ability to balance long-term platform strategy with near-term business priorities.
Ability to collaborate effectively across engineering, product, data science, and business teams.
Strong communication skills with the ability to translate business requirements into scalable data solutions.
Strong analytical and problem-solving skills with a focus on building scalable, maintainable systems.
Ability to balance long-term platform strategy with near-term business priorities.

Skills & Technologies

Machine LearningAzureSQLPython

About the Company

Scorpion

View company profile →

Interested in this role?

Sign in or create a free account to see how this job matches your skills, apply with one click, and let our AI tailor your resume.

AI-powered resume optimization

Save and track your applications

Job Details

Employment Type

Full Time

Experience Level

Senior

Salary Range

$155,000 – $185,000

Location

USA

Work Mode

Remote

Posted

10 days ago

Country