Search
Close this search box.

Senior Databricks Data Engineer

Irving, TX 75039

Category: Other Area(s) Job Number: 41859 Location Requirements: Remote

Job Description

Senior Databricks Data Engineer
- Direct Hire
- 100% Remote
- Must be authorized to work in the U.S. 

Description:
  • Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals.
  • Collaborate with data engineers, data consumers, and other team members to come up with simple, functional, and elegant solutions that balance the data needs across the organization.
  • Solve complex data problems to deliver insights that helps the organization achieve its goals.
  • Create data products that will be used throughout the organization.
  • Advise, consult, mentor and coach other data and analytic professionals on data standards and practices.
  • Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytic solutions.
  • Develop and deliver documentation on data engineering capabilities, standards, and processes; participate in coaching, mentoring, design reviews and code reviews.
  • Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
  • Deliver awesome code.
Technical Qualifications:
  • 7+ years relevant and progressive data engineering experience.
  • Deep Technical knowledge and experience in Databricks, Python, Scala, Microsoft Azure architecture and platform including Synapse, ADF (Azure Data Factory) pipelines and Synapse stored procedures.
  • Hands-on experience working with data pipelines using a variety of source and target locations (e.g., Databricks, Synapse, SQL Server, Data Lake, file-based, SQL and No-SQL database).
  • Experience in engineering practices such as development, code refactoring, and leveraging design patterns, CI/CD, and building highly scalable data applications and processes.
  • Experience developing batch ETL pipelines; real-time pipelines are a plus.
  • Knowledge of advanced data engineering concepts such as dimensional modeling, ETL, data governance, data warehousing involving structured and unstructured data.
  • Thorough knowledge of Synapse and SQL Server including T-SQL and stored procedures.
  • Experience working with and supporting cross-functional teams in a dynamic environment.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Knowledge and understanding of Boomi is a plus.
Additional Qualifications and Experience:
  • Excellent problem-solving skills and experience.
  • Effective communication skills.
  • Strong collaboration skills.
  • "Self-starter" attitude and the ability to make decisions with minimal guidance from others.
  • Innovative and passionate about your work and the work of your teammates.
  • Ability to comprehend and analyze operational systems and ask appropriate questions to determine how to improve, migrate or modify the solution to meet business needs.
  • Experience with data ingestion and engineering, specifically involving large data volumes.
  • Knowledge of CI/CD release pipelines is a plus.
  • Understanding of Python and knowledge of parallel processing frameworks like MapReduce, Spark, Scala.
  • Knowledge of the Agile development process.
Working Conditions:
  • Remote.
  • Occasional time outside of core hours depending on priorities and deliverables.
  • Some travel (with advance notice) may be required for training, team meetings or other events.
Education:
  • Bachelor’s degree in computer science, information technology, business management information systems, or equivalent experience.

Meet Your Recruiter

Perry Gross

Text me about this job - 972-419-1628
Please include your name and Job Title in your Text.
Thanks!
Apply Online

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.

About Irving, TX

Discover exciting job opportunities in the vibrant city of Irving, Texas! Known for its diverse community and thriving economy, Irving offers endless possibilities for career growth and development. With its close proximity to Dallas Fort Worth International Airport, major corporations, and charming neighborhoods like Las Colinas, Irving is the perfect place to advance your career. Explore job listings in this bustling city and be part of the dynamic energy that surrounds attractions like the Toyota Music Factory, the Irving Arts Center, and the Mustangs of Las Colinas sculpture. Embrace the blend of Texan hospitality and cosmopolitan flair that makes Irving a truly exceptional place to work and live. Take the next step in your career journey and find your perfect match in Irving, Texas!