Data Engineer - High Performance Compute (TS/SCI required)

Company: Innovative Data Solutions LLC
Location: Springfield
Posted on: May 28, 2023

Job Description:

Job Summary
We are seeking an experienced High Performance Compute Data Engineer to support an IC customer in -Springfield, -VA. This position requires an existing TS/SCI clearance and -eligibility to obtain a CI polygraph. -Duties and Responsibilities

• Identify data sources and automate collection processes
• Perform preprocessing of structured and unstructured data
• Analyze large, complex data sets to identify trends and patterns
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
  • Present information using data visualization techniques
  • Designs data integrations and data quality frameworks
    • Designs and evaluates open source and vendor tools for data lineage
    • Propose solutions and strategies to address Key Intelligence Questions
    • Collaborate with engineering and product development teamsRequired Skills:
      • High level -of experience in a Linux environment
      • Direct experience and demonstrated proficiency with multiple programming and scripting languages preferred MPI, OpenMP, Python, Julia, R, Java
      • Above average -SQL experience (No-SQL experience is a plus)
        • Experience designing, building, and maintaining data processing and management systems
        • Experience in data mining and data transformations
        • Experience building robust, secure data pipelines using industry standard tools and techniques (e.g. Kafka, Nifi, Spark, etc
        • Experience using analytic tools; specifically, JupyterHub and Tableau
        • Experience working with either a Map Reduce or an MPP system on any size/scale
          • Experience with retrieving data from, and creating Data Lakes, Date Warehouses, and other data storage constructs
          • Strong problem solving and troubleshooting skills
          • Strong communication and interpersonal skills
          • Must possess excellent time management skills and the drive to work unsupervised
          • Experience with deploying to on prem/data center infrastructureDesired Skills:
            • Understanding of access management and security groups (i.e. IAM, S3 bucket, SSH, VPN, etc.)
            • Prior experience working with or within the Intelligence Community or a military intelligence uniEducation/Qualifications:
              • Active TS/SCI clearance required and eligibility to obtain a CI poly
              • Bachelor's Degree in Computer Science, Engineering or a related technical discipline, or the equivalent combination of education, technical training, or work/military experience.Benefits and PerksCompensation
                • Industry competitive salary well above market average
                • 401K plan with 4% company match, immediately fully vested
                • Referral bonuses up to $7,000100% company-paid benefits
                  • Cigna OAP $0 deductible -Medical plan for employee + family
                  • Vision and Dental plan for employee + family
                  • Short Term Disability for employee
                  • Long Term Disability for employee
                  • Life Insurance for employeeFlexible Paid Time Off Policy
                    • 180 hours (minimum) -per year of PTO with additional time at manager discretion
                    • 10+ Company Holidays per year
                    • 6 weeks paid maternity and paternity leave
                    • Flexible work environment to accommodate commuting, family and personal schedulesCareer Growth
                      • Company sponsored training and certifications
                      • No questions asked professional/business/technical book reimbursement
                      • Company paid training and conference attendance and travel expenses
                        Company Overview
                        Innovative Data Solutions -(IDS) is a small business specializing in engineering and supporting mission critical IT infrastructure for the US Government Intelligence, Defense and Homeland Security communities.Established in 2008, IDS has 14 -years of experience delivering IT solutions to the Federal market. -We're a small company of technology enthusiasts and we thrive on exceeding expectations. -We specialize in Hybrid Cloud Infrastructure, Enterprise Storage, High Performance Computing, Cybersecurity and Data Analytics. -Across these technology areas we provide full lifecycle services: strategy, design, implementation and operations.IDS engineers are based in Washington, DC and St. Louis, MO and are experienced working with US Government installations across the US, Europe and Asia. -Powered by JazzHR

Keywords: Innovative Data Solutions LLC, Washington DC , Data Engineer - High Performance Compute (TS/SCI required), Engineering , Springfield, DC