All Jobs

03/Aug/2023

Jr/Sr/Lead Data Engineer

(No. of Positions-10)

Location - Noida, Remote | Full-Time

Job Summary

The Data Engineer is an Individual who assists with the development and maintenance of the company’s data storage systems and data movement processes. Candidate’s responsibilities include expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for various projects and functional teams.

The Data Engineer will build new data pipelines and engines using modern cloud data tools that support our software developers, database architects, data analysts, and data scientists. The Engineer will ensure optimal data delivery architecture is consistent throughout ongoing projects and generate new architecture to support our next generation of products and data initiatives.

Candidate must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. An enthusiast with good hands-on experience around the prospect of optimizing or even re-designing existing data architecture to continue to adapt to latest technology.

• Education Requirements

  BE/B.Tech/MCA Degree in Computer Science, Engineering, or similar relevant field

• Salary

  Not Disclosed

• Benefits/Hours

  Medical Coverage, Accidental Insurance, Life Insurance, Eligibility to Gratuity after 5 years of continuous service, Paid Time Off, Paid Holidays and Floating Holidays

Primary Responsibilities

• Develop, construct, test and maintain data storage systems including traditional SQL databases, No-SQL Solutions such as Mongo, BLOB Storage, and others.
• Create and maintain optimal data pipelines leveraging SSIS, Data Factory, Databricks, and others.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Identify ways to improve data reliability, efficiency, and quality.
• Work with data and analytics experts to strive for greater functionality in our data systems.
• Integrate data tools for analytics and data scientist team members and assist them in building and optimizing our product into an innovative industry leader.

Knowledge & Skills Requirement

• Bachelor’s degree in computer science or related field.
• 3+ years of experience working with Microsoft SQL Databases
• 3 years designing SQL Architecture including table design, index optimization, partitioning strategies, and others.
• 1- 5 years of experience developing data scripts using Python.
• 1- 3 years working in the Azure Cloud environment
• Experience with Databricks is a plus (required for Mid-Level and Sr)

Additional Qualifications

• Working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing ‘big data’ data pipelines utilizing ETL software including SSIS, Data Factory, and others.
• Python experience with Pandas DataFrames, PySpark, NumPy, and other analytics libraries.
• Experience with RESTful APIs, Service Bus, and other orchestration tools.
• Understanding of working with containerized Apps utilizing Docker and Kubernetes a plus.
• Experience building ETL solutions with non-SQL databases like Mongo DB.
• Understanding of Azure cloud data technologies like Azure SQL, Data Factory, Parallel Data Warehousing, Azure Databricks, Azure Synapse etc.
• Ability to prioritize and manage work to critical project timelines in a fast-paced environment.
• Proven ability to communicate at all levels with both business and technology leaders, with a strong understanding of business data requirements and technology capabilities.
• Strong attention to detail.