Senior Data Engineer - Hadoop

Company: M&T Bank
Location: Wilmington
Posted on: November 25, 2022

Job Description:

This role follows a hybrid work schedule; offering the flexibility to work remotely two days a week, while providing the opportunity for onsite and in person collaboration the other three days.
This position is available in Buffalo, NY or Wilmington, DE

About the TeamOur team is on a mission of unleashing the power of data to support decision making. Our team builds enduring data products, provides platforms to access & derive insights from data, enables confidence in decision making with appropriate data governance, delivers actionable insights through use of data science and activates value for the business by innovatively solving problems with data. We love translating data, insights, and anecdotes into action, we operate with a sense of urgency, have a startup mentality, build data analytics products at scale, and innovate solutions on behalf of our customers. We work hard but value the need for downtime to unplug and recharge. We embrace our differences and view them as a key driver of innovation. We are &T.
Role Overview: The Central Data Team builds new and enhances existing data pipelines from various sources into Hadoop. A successful Team member understand the concepts related to Data processing, Data Enrichment, Data Storage, Data Provisioning/Consumption, Data Archival, Data Quality, Data Lineage, Data Security, and other related capabilities.
As part of the Central Team, this role interacts with both upstream source applications looking to get their data into Hadoop; along with various downstream Domain Teams (Finance, Consumer/Marketing, Commercial) looking to utilize Hadoop to meet their business partner's needs. This Team will also play a key role in the transition of this dataset to the Cloud.
Area(s) of Focus: All Success with Rely on Cross Group Communication and Planning

• Improve Cross Domain Solutions: Reduce duplicated solutions and cost while improving cross domain communication and collaboration.
• Realize Business Needs: Assess future Domain needs and work closely with other groups to bring those needs to realization.
• Development Efficiency: Provide business with a competitive edge by improving our speed to market and cost to deliver.
• Domain Migration to Cloud: Working with the Cloud & Modernization group the Domains will need to Scope, Size and Plan their Migration to Cloud.
• Modernizing Code and Designs: Fully Automated Deployments for ALL changes, Improved Defensive Coding, Automated Testing, Automated Code Scanning, and More.
• Enable Business Agility: Designs and Solutions focusing on enabling the business for rapid change, enabling agility while operating in control.
  The successful candidate will have:
  • Minimum of an Associate degree and 6 years' systems analysis/application development experience, or in lieu of a degree, a combined minimum of 8 years' higher education and/or work experience
  • Experience with Agile Methodology
  • An ability to build out data products & product enhancements from idea through to launch
  • Strong collaboration with technology partners and customers on feature requirements and prioritization
  • A team player mindset with an ability to thrive and effectively communicate in a fast-paced, constantly evolving environment
    Tech Stack:
    • Hadoop
    • Informatica
    • Automic
    • Unix shell scripting
    • SQL
    • Python
    • Snowflake on Azure
      Required Technology skills
      • Experience creating data pipelines using various source/target structures
      • In-Depth Knowledge of SQL and Other Database Solutions - preferable in Hadoop
      • Experience in big-data technologies, such as: Hive, Impala, Kudu
      • Informatica (or equivalent) tools: PowerCenter, Big Data Manager
      • Programming skillsets in at least one of these languages: Java, Scala, Python
      • Experience in Unix/Linux operating systems, with scripting expertise
      • CA Automic or equivalent enterprise job scheduling tool experience
        Preferred Technology skills
        • Experience working with multiple file structures - Mainframe, Flat files, Json, XML's
        • Cloud computing (Azure, AWS)
        • Experience in Cloud data platforms (Snowflake, Databricks)
        • Realtime processing like Spark streaming, Kafka
          Preferred Other skills:
          • Agile (such as JIRA), Source code repository (Git, Bitbucket, etc.) CI/CD tools (Jenkins, Teamcity, etc.)
          • Business acumen, familiarity with banking concepts
          • Strong analytical skills, ability to tackle non-trivial business requests
            Hiring Immediately. We support our team members with generous benefits.
            • Competitive compensation
            • Health, welfare, and retirement benefits
            • 401(k) match at 5%
            • Work-life balance and flexible work arrangements
            • Banking Officers start with 25 days PTO plus 12 paid holidays
              Company:
              At M&T Tech, we're a team of makers, doers, and builders, working to create the most advanced technology solutions in banking. We're not your stereotypical suit and tie bankers: We're an innovative team of leading tech experts, pushing boundaries, and taking risks. We're building an agile team of the most skilled and creative, workers to solve complex problems, architecting solutions, writing high-performance software, and charting our new path, all to make the lives of our customers, and the communities that we serve, better. Join us and be part of something new as we build tomorrow's bank, today.
              M&T Bank is a Top 20 US bank holding company and one of the best performing and financial stable regional banks in the country, we offer our technology employees a wide range of performance-based career development opportunities. We have a strong commitment to our customers and the communities we serve, and we continue to grow with a focus on the future. So, when looking to advance your career, look to M&T. Grow with us.
              
              LocationWilmington, Delaware, United States of America

Keywords: M&T Bank, Wilmington , Senior Data Engineer - Hadoop, Accounting, Auditing , Wilmington, Delaware