NRG Systems

Job 174569 - Big Data Engineer
Hinesburg, VT

  Sign In Job List   

Job Details

Location: Hinesburg, VT
Employment Type: Full-Time
Salary: Competitive

Job Description

Key Focus:

 

The Big Data Engineer will contribute to NRG’s strategic product portfolio. This role focuses on architecture, design and implementation of development focused on collecting, aggregating, storing, reconciling and making data accessible from disparate sources to enable analysis and decision making. Work will include establishing relevant policies; addressing and managing data governance; modeling data structures, data flows, and other data architecture as needed; further developing ETL strategy and implementation; and identifying and addressing system constraints related to performance, scalability, availability, reliability, and disaster recovery of NRGs application data storage and data pipelines.

 

This is a full-time, highly-valued individual contributor position in the engineering department and reports to the Manager of Software Engineering. This position will work collaboratively with other software developers, product managers and data scientists to achieve Engineering Department goals in line with the company strategic plan, and will embrace the high standards of NRG ethics, core values, quality and culture.

 

Responsibilities

 

• Develop system capabilities in all phases of the development life cycle, including: system development and enforcement of data governance and provenance policies, procedures, standards and supporting documentation; database design; stream design; process flow analysis; development; benchmark analysis, performance/tuning; capacity planning; and production implementation

• Research and apply solution-appropriate technologies; make recommendations

• Drive assigned work to successful completion

• Rapid prototyping of candidate solutions

• Production support responsibilities include maximizing system availability, ensuring swift and complete database recovery, optimizing data availability and throughput through ongoing maintenance, ensuring conformance to audit and operating standards, troubleshooting data inconsistency issues, and establishing effective metrics and monitoring

• Participate effectively in design and code reviews

• Provide input to development plans, reports, and other documentation as required

• Become a process owner in developing and continuously improving data engineering practices and tools • Mentor fellow team members in the technologies used and solutions developed

Requirements

Qualifications:

 

Minimum Technical Skills

 

• Bachelor’s Degree or equivalent in Computer Science, Information Systems, or related a discipline

• 8-10 years’ experience in data modeling, database/data warehouse implementation, and ETL development

• 5+ years’ experience with NoSQL technologies (e.g., MongoDB, Cassandra, Couchbase, Neo4j, etc.)

• 5+ years’ experience with Data Lakes, Hadoop, and Big Data ingestion, streaming and eventing technologies (e.g., Sqoop, Pig, Hive, Flume, Kafka, Spark, Splunk, AWS Kinesis, Azure Event Hubs, RabbitMQ, etc.) and data integration products (e.g., Boomi, MuleSoft, Talend, etc.)

• Experience designing and delivering large scale, 24-7, mission-critical data pipelines

• Experience designing, implementing, and automating tests for data transformations and migrations

• Experience developing solutions for deployment on premise and in the cloud

• Experience developing single and multi-tenant solutions

• Experience with one or more cloud vendors’ Big Data infrastructure and service offerings

• Expert proficiency in Python

• Familiarity with REST APIs

• Experience practicing Agile methodologies (esp. Scrum and XP) Preferred Technical Skills

• Experience with business intelligence tools such as Tableau

• Experience with microservices and distributed architectures

• Moderate proficiency with C#

• Familiarity with R

• Familiarity with cybersecurity concerns and experience working with cybersecurity experts to evaluate and address privacy and security risk in data pipelines

 

Required Interpersonal Skills

 

• Functions with a sense of urgency and a desire to demonstrate results

• Strong attention to detail

• Engages internal and external customers

• Demonstrates curiosity; desire to learn our business, our customers and new technologies

• Desire to take initiative to advance the goals of the department

• Ability to be productive in the face of ambiguity

• Thinks strategically with deliberate objectivity (think outside the box)

 

Working Conditions/Physical Requirements

 

• Work performed in a climate-controlled office environment

• Primary duties performed in a seated position

• Occasional domestic and/or international travel required to meet with vendors, partners, customers, et al.

Send to a Friend