ArlingtonHeightsRecruiter Since 2001
the smart solution for Arlington Heights jobs

Sr/Lead Databricks Engineer

Company: UST
Location: Deerfield
Posted on: November 22, 2021

Job Description:

-- UST is a leading provider of platforms, digital innovation, artificial Intelligence and end-to-end IT & Business services and solutions for Global 1000 companies. We are transforming corporations through deep domain expertise, knowledge-based ML platforms, as well as profound anthropological efforts to understand the end customer and design products and interactions that create delight. We are deeply committed to developing a comprehensive understanding of our clients--- problems and to develop platforms to address them.-- Databricks Engineer Fulltime/Directhire/W2 with UST Deerfield,IL-- Description: UST is looking for Engineers: who have experience in Databricks. Should be capable of programming in Python, Pyspark, Scala and Spark SQL. Responsibilities: As a Databricks Engineer you:

  • Should be able to work with other professionals to ensure successful implementation of proposed designs and completion of projects.
  • Should be responsible for the development, and integration of computer programs.
  • Should understand the business needs and works strictly in compliance with the needs of the client.
  • Requirements:
  • Capability or programming in one of the following languages.
  • Python/Pyspark
  • Scala
  • Spark SQL
  • Deep understanding of distributed computing and Spark Architecture
  • Experience with Delta Lake/Tables within Databricks
  • Experience with optimizing Spark Queries and analyzing Spark DAGs
  • Understanding of both Batch and Streaming Jobs in Spark
  • Familiarity with different file types such as CSV, Parquet, JSON, etc.
  • Experience with other Azure data services such as Azure Data Lake Gen2, Event Hubs, Synapse etc.
  • Understanding of ETL/ELT practices including data cleansing, validation, and transformation activities. Location :This position is based in Deerfield Illinois. UST will provide relocation assistance. Role Proficiency: Act creatively to develop applications by selecting appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions. Account for others' developmental activities; assisting Project Manager in day to day project execution. Outcomes:
  • -- Interpret the application feature and component designs to develop the same in accordance with specifications.
  • -- Code debug test document and communicate product component and feature development stages.
  • -- Validate results with user representatives integrating and commissions the overall solution.
  • -- Select and create appropriate technical options for development such as reusing improving or reconfiguration of existing components while creating own solutions for new contexts
  • -- Optimises efficiency cost and quality.
  • -- Influence and improve customer satisfaction
  • -- Influence and improve employee engagement within the project teams
  • Set FAST goals for self/team; provide feedback to FAST goals of team members Measures of Outcomes:
  • -- Adherence to engineering process and standards (coding standards)
  • -- Adherence to project schedule / timelines
  • -- Number of technical issues uncovered during the execution of the project
  • -- Number of defects in the code
  • -- Number of defects post delivery
  • -- Number of non compliance issues
  • -- Percent of voluntary attrition
  • On time completion of mandatory compliance trainings Outputs Expected: Code:
  • Code as per the design
  • Define coding standards templates and checklists
  • Review code --- for team and peers Documentation:
  • Create/review templates checklists guidelines standards for design/process/development
  • Create/review deliverable documents. Design documentation requirements test cases and results Configure:
  • Define and govern configuration management plan
  • Ensure compliance from the team Test:
  • Review/Create unit test cases scenarios and execution
  • Review test plan created by testing team
  • Provide clarifications to the testing team Domain relevance:
  • Advise software developers on design and development of features and components with deeper understanding of the business problem being addressed for the client
  • Learn more about the customer domain and identify opportunities to provide value addition to customers
  • Complete relevant domain certifications Manage Project:
  • Support Project Manager with inputs for the projects
  • Manage delivery of modules
  • Manage complex user stories Manage Defects:
  • Perform defect RCA and mitigation
  • Identify defect trends and take proactive measures to improve quality Estimate:
  • Create and provide input for effort and size estimation and plan resources for projects Manage knowledge:
  • Consume and contribute to project related documents share point libraries and client universities
  • Review the reusable documents created by the team Release:
  • Execute and monitor release process Design:
  • Contribute to creation of design (HLD LLD SAD)/architecture for applications features business components and data models Interface with Customer:
  • Clarify requirements and provide guidance to Development Team
  • Present design options to customers
  • Conduct product demos
  • Work closely with customer architects for finalizing design Manage Team:
  • Set FAST goals and provide feedback
  • Understand aspirations of the team members and provide guidance opportunities etc
  • Ensure team members are upskilled
  • Ensure team is engaged in project
  • Proactively identify attrition risks and work with BSE on retention measures Certifications:
  • Obtain relevant domain and technology certifications Skill Examples:
  • -- Explain and communicate the design / development to the customer
  • -- Perform and evaluate test results against product specifications
  • -- Break down complex problems into logical components
  • -- Develop user interfaces business software components
  • -- Use data models
  • -- Estimate time and effort resources required for developing / debugging features / components
  • -- Perform and evaluate test in the customer or target environments
  • -- Make quick decisions on technical/project related challenges
  • -- Manage a team mentor and handle people related issues in team
  • -- Have the ability to maintain high motivation levels and positive dynamics within the team.
  • -- Interface with other teams designers and other parallel practices
  • -- Set goals for self and team. Provide feedback for team members
  • -- Create and articulate impactful technical presentations
  • -- Follow high level of business etiquette in emails and other business communication
  • -- Drive conference calls with customers and answer customer questions
  • -- Proactively ask for and offer help
  • -- Ability to work under pressure determine dependencies risks facilitate planning handling multiple tasks.
  • -- Build confidence with customers by meeting the deliverables timely with a quality product.
  • -- Estimate time and effort of resources required for developing / debugging features / components Knowledge Examples: Additional Comments: None

Keywords: UST, Arlington Heights , Sr/Lead Databricks Engineer, Engineering , Deerfield, Illinois

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest Illinois jobs by following @recnetIL on Twitter!

Arlington Heights RSS job feeds