Azure Data Engineer Job at Tech3pillars Technologies, Mississippi

  • Tech3pillars Technologies
  • Mississippi

Job Description

Job Title: Azure Data Engineer

Location: Boston, MA Hybrid

Job Description:

Skill Set

Databricks, Python, PySpark, Scala, SQL, Azure, Data warehousing

Job Description

Databricks Engineer: 9+ years of total experience with 5+ years relevant experience in the mandatory skills.

Mandatory Skills : Databricks, Hadoop, Python, PySpark, Scala, SQL, Azure/AWS cloud services

Required Skills & Experience:

  • Very strong hands-on experience in Databricks with Azure cloud service in Data engineering/Data processing development projects implementing on Data warehouse.
  • Hands-on experience in Azure/AWS Cloud-based development and integration
  • Proficiency in programming languages Scala and Spark Data frame for data processing and application development
  • Strong knowledge and experience in Facts, Dimensions, data Partitions, and handling large volume of data.
  • Experience in handling large data in Databricks and performance optimization as well
  • Practical experience with Data Engineering, Data Ingestion/Orchestration and the accompanying DevOps with CI-CD tools
  • Strong knowledge of Spark, Databricks SQL - Data engineering pipeline implementing in Data warehouse
  • Experience in offshore/onshore model and Ability and agile methodology.
  • Gathering requirements, understand the business need and regular discussion with tech on design, development activities.
  • Should have good experience working with client architect/design team to understand the architecture, requirements and work on the development.
  • Experience working in a Financial Industry.
  • Certification on Databricks and Azure will be added advantage

Work Location

Boston (MA)

BGC Post or Before Onboarding

BGC Before onboarding. There is a separate BGC from client side.
Client BGC and onboarding must need to be complete to start in the project.

Must Have Skills

Databricks, Scala, PySpark, Python, Data warehousing
Good Communication Skills

Work Model

Hybrid (4 days to work from Client office at Boston)

Job Tags

Work at office

Similar Jobs

Veolia

Commercial Contracts Manager Job at Veolia

 ...that are both useful and practical for water, waste and energy management. Through its three complementary business activities, Veolia...  ...million metric tons of waste. Job Description The Commercial Contracts Manager will be responsible for providing world-class... 

Mohawk Industries

C SHIFT PRESS/GLAZE LINE SUPERVISOR PRODUCTION Job at Mohawk Industries

 ...dental, and a belief that every employee deserves a productive life outside of work. If this sounds outstanding to you, take the first step forward and explore a career with Dal-Tile. Job Objective: The Supervisor Production is an entry-level leader role that... 

Riser Fitness, LLC

District Manager Job at Riser Fitness, LLC

 ...DISTRICT MANAGER JOB TITLE : District Manager REPORTS TO : Director of Sales/Operations COMPENSATION : $80,000-85,000 Base Salary + Bonus Opportunity up to $36,000 annually JOB TYPE: Full Time COMPANY OVERVIEW: Riser Fitness, established in 2013,... 

Boston Medical Center

Part-Time Child Protection Team Pediatrician/Family Medicine Physician/Advanced Practice Nurse, Boston Medical Center Job at Boston Medical Center

 ...a Pediatrician, Family Medicine Physician, or Advanced Practice Nurse to join the BMC Child Protection Team. The Child Protection Team...  ...watching the Patriots, Celtics, Bruins, and Red Sox, then hop a flight to Paris at Logan International Airport, just 10 minutes from downtown... 

Valley Forklift

Parts Associate Job at Valley Forklift

Job Description Job DescriptionValley Forklift, a leading equipment dealer in Stockton has an immediate opening for our parts department. We have been serving the Central Valley area for over 20+ years. Duties:Parts RunnerPress Tireskeeps inventory levels at appropriate...