Data Engineer and Analyst 58 views

Cyient is a global engineering and technology solutions company. As a Design, Build, and Maintain partner for leading organizations worldwide, we take solution ownership across the value chain to help clients focus on their core, innovate, and stay ahead of the curve. We leverage digital technologies, advanced analytics capabilities, and our domain knowledge and technical expertise, to solve complex business problems.

With over 15,000 employees globally, we partner with clients to operate as part of their extended team in ways that best suit their organization’s culture and requirements. Our industry focus includes aerospace and defence, healthcare, telecommunications, rail transportation, semiconductor, geospatial, industrial, and energy.

Job Description

About the Role:

We are looking for a developer who will join us at our Hyderabad location and perform data architecture functions for digital solution. You will integrate data to build dashboards for analytics insights, and automate tests and prepare environments for deployment.

You Will:

  • You have to improve our data and data pipeline architecture, and optimising data flow and collection for teams.
  • 3 years of experience as a Data Engineer.
  • You will support software developers, database architects, data analysts and data scientists on data projects and will ensure data delivery architecture is consistent throughout ongoing projects.
  • Create data pipeline architecture.
  • Assemble complex data sets that meet functional / non-functional requirements.
  • Implement internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability.
  • Develop real-time data ingestion pipelines.
  • Identify and provide solutions for areas where automation of data flow processes is possible using data integration
  • Work on ETL Tools for data warehousing and analysis
  • Support and assist the general IT service functions pertaining to CRM data Administration and SharePoint as required
  • Handle Data protection execution endeavors on operational basis
  • Develop Dashboard and Report for business insights and process improvement.

You’ll Need:

  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and scalable ‘big data’ data stores.
  • Experience in Develop data pipelines using Azure Data Factory, SQL data base and Data Lake, Databricks.
  • Experience with big data tools: Hadoop, Spark, Kafka.
  • Experience with relational SQL and NoSQL databases, including Cosmos DB , Postgres and Cassandra.
  • Experience with object-oriented/object function scripting languages: Python
  • Experience in RDBMS like MS SQL Server, MySQL, PostgreSQL, MongoDB.
  • Strong analytic skills related to working with structured/unstructured datasets.
  • Ability to Write unit/integration tests, contributes to engineering wiki, and documents work
  • Extensive knowledge in Developing & Deploying SSIS Packages; log creation, checkpoints and Error Handing in SSIS packages
  • Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, remove duplicates, Filter, Dataset, Lookup file set, Modify, Aggregator, XML parsing stages (Standard knowledge/experience and need not be expert)
  • Expert knowledge of SQL DDL,DML, Stored Procedures, functions, triggers, views and locks
  • Good to have experience with any visualization tool (Power BI/Tableau)/AWS Quicksight/GCP Datastudio
  • Migrating onprem datawarehouse/datamart to modern cloud data warehousing
  • Familiarity with Agile development methodologies and tools like Jira, confluence
  • Used SAS platform, macros and CRON to perform data mining, predictive modeling and statistical analysis to analyze and interpret customer behaviors, product performance, trends etc.
  • Experience using digital & statistical modeling software – R, Revo R (Preferred), SAS Basic & Enterprise Miner (Preferred), SQL (Preferred), SPSS Any of the Big Data querying language (Hive, PIG, Hadoop, etc.)
  • 4+ years of experience in R/Python
  • 2-3 years of experience with a visualization tool (Power BI/Tableau)/AWS Quicksight/GCP Datastudio

Secondary Skills:

  • Experience with data pipeline and workflow management tools: Azure Monitor, Azkaban, Luigi, and Airflow
  • Experience with stream-processing systems: Spark-Streaming.
  • Reporting tools: Power BI, tableau

Good to have:

  • Experience with AWS cloud services: EC2, EMR, RDS, or Redshift
  • Understanding of messaging infrastructure like event hub, service bus and notification hub.
  • Experience with stream-processing systems: Storm
  • Bachelor’s/Master’s degree in Computer Science, Mathematics, Operation Research or Statistics
  • 7 or more years of experience in related field
  • Effective interpersonal and communication skills

You will report to the Technical Lead for Data Engineering and Analytics

Skills & Experience Data Analysis Using SPSS, Data Engineering, ETL Pipelines

Cyient is an Equal Opportunity Employer.

Cyient recruits, employs, trains, compensates, and promotes regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, veteran status, and other protected status as required by applicable law. We are proud to be a diverse and inclusive company where our people can focus their whole self on solving problems that matter.

More Information

Only candidates can apply for this job.
Share this job
Company Information
  • Total Jobs 444 Jobs
  • Location INDIA

Contact Us