SoftServe

Senior Big Data Engineer (Databricks)

Job description

WE ARE

SoftServe is a global digital solutions company, headquartered in Austin, Texas, founded in 1993. Our team is passionate innovators working on over 2,000 cutting-edge projects around the globe. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains across North America, EMEA, APAC, and LATAM.

We are a Big Data & Analytics Center of Excellence, a data consulting, and data engineering branch of SoftServe. Starting as a group of 3 enthusiasts in 2013, with almost 200 Data Engineers and Architects nowadays, we build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like Databricks, Snowflake, Confluent, Cloudera, Starburst, Collibra, Tableau, and others.

Together with the SEI and Carnegie Mellon University, we adapted ADD and ATAM architecture design methodologies to Big Data needs and invented the Smart Decisions game to promote architecture design best practices in AI and Big Data.

IF YOU ARE

  • Possessing at least 1+ year of hands-on experience in working with Databricks and Azure Cloud services, demonstrating a track record of successful projects
  • Deeply understanding the Databricks' architecture, components
  • Skilled in PySpark
  • Proficient in data modeling, data warehousing, and data lake, and data lakehouse concepts, so as implementing these in Databricks
  • Adept in Python and SQL, with the ability to write efficient, maintainable code
  • Experienced in solving complex data challenges and optimizing processes
  • An outstanding communicator, effective in teamwork with both technical and non-technical peers
  • Familiar with data services provided by Azure Cloud (ADF, Synapse, Event Hub, ADLS gen2, etc.), leveraging cloud capabilities for enhanced data solutions


AND YOU WANT TO

  • Analyze legacy solutions and develop strategic migration plans to Databricks
  • Create scalable, efficient data architectures on Databricks, focusing on best practices
  • Rewrite and manage the migration of data processes to Databricks, ensuring data integrity
  • Build and continuously enhance data solutions on Databricks for better performance and efficiency
  • Manage rigorous testing and smooth deployment processes, ensuring solutions meet requirements
  • Establish monitoring for Databricks environments and proactively maintain for optimization


TOGETHER WE WILL

  • Access 11,300+ learning solutions with SoftServe University and Udemy Business
  • Gain certifications from leading providers (Microsoft, Google, AWS & others)
  • Empower you to scale your expertise with others by joining the Mentoring Program
  • Excel business of our clients from startups and ISVs to Enterprise and Fortune 500 companies
  • Create an exceptional customer experience impact the company's global success and be recognized by the Customer Hero Program
  • Care for your wellness with a health insurance package






SoftServe is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment regardless of race, color, religion, age, sex, nationality, disability, sexual orientation, gender identity and expression, veteran status, and other protected characteristics under applicable law. Let’s put your talents and experience in motion with SoftServe

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.