data-warehousing-jobs-in-tiruchirappalli, Tiruchirappalli

1 Data Warehousing Jobs nearby Tiruchirappalli

Toggle to save search
posted 2 months ago
experience5 to 9 Yrs
location
Tiruchirappalli, Tamil Nadu
skills
  • Inventory Management Expertise
  • DMS Software Proficiency
  • Analytical
  • ProblemSolving Skills
  • Organizational
  • Time Management Skills
  • Communication
  • Interpersonal Skills
  • Leadership
  • Teamwork
Job Description
You are being sought after to take on the role of Senior Inventory Manager at [Kidza]. As the Senior Inventory Manager, you will be responsible for overseeing the entire inventory lifecycle, ensuring optimal stock levels, and enhancing supply chain operations. Your expertise will play a crucial role in making data-driven decisions and implementing best practices to improve inventory accuracy and reduce costs. **Key Responsibilities:** - **Inventory Management:** - Maintain accurate records of inventory levels across multiple locations using (Data Management System) software. - Monitor stock levels and identify potential shortages or overstocks. - Forecast inventory needs based on sales data, demand patterns, and lead times. - Implement inventory control procedures to minimize losses due to damage or obsolescence. - Conduct regular inventory audits and reconciliations. - **Inventory Control:** 1. Develop and monitor inventory management systems to ensure accuracy of inventory levels, orders, and deliveries. 2. Develop and implement effective inventory control procedures and systems. 3. Monitor stock levels and order supplies as necessary. 4. Monitor and resolve inventory discrepancies. 5. Analyze and report inventory usage and adjustments. 6. Plan and coordinate cycle counts to ensure accuracy of inventory. 7. Analyze and report inventory performance metrics. 8. Collaborate with vendors to ensure timely delivery of goods. 9. Monitor and analyze inventory costs and recommend cost-saving measures. 10. Develop and implement inventory management policies and procedures. - **Inventory Manager Duties:** - Prepare inventory for shipment to customers. - Analyze sales data and inventory requirements. - Maintain a high level of accountability in the warehouse. - Set up local warehousing management systems. - Provide problem resolution in warehouses. - Order products and inventory to meet business needs. - Develop database systems to store information about inventory. - Monitor safety regulations in the warehouse. - Maintain processes resulting in efficient inventory movement through a warehouse distribution center, especially when operating at maximum capacity. - Use training courses and tools for improving performance in the warehouse. - Develop relational database systems to store information about inventory. **Qualifications Required:** - 5+ years of experience in inventory management or supply chain management, with a strong track record of optimizing inventory processes. - Deep understanding of inventory management principles, methodologies, and best practices. - Proficiency in inventory management software and ERP systems, with the ability to analyze and interpret complex data. - Strong analytical skills, with experience in forecasting and demand planning. - Excellent communication and leadership skills, with the ability to collaborate effectively across teams. **Preferred:** - Bachelor's degree in supply chain management, logistics, (FMCG), or a related field. - Experience working in a warehouse or distribution environment. - Experience with Lean or Six Sigma methodologies. - Familiarity with e-commerce platforms and distribution channels. The work location for this position is at Kattur, Trichy - 620019. **Benefits:** - Yearly Bonuses - Good Salary - Good work environment - Incentives The languages required for this role are Tamil & English. **Schedule:** Day shift. **Interview Location and Contact Details:** Kidza (Showroom) Kattur, Trichy-620019 Email: hr@kidza.co.in Phone: 7639499944 This is a full-time job opportunity that requires in-person work.,
ACTIVELY HIRING

Top Companies are Hiring in Your City

For Multiple Roles

Jio Platforms Ltd
Jio Platforms Ltdslide-preview-Genpact
posted 1 week ago

GCP Data Engineer

Hucon Solutions India Pvt.Ltd.
Hucon Solutions India Pvt.Ltd.
experience5 to 9 Yrs
Salary10 - 20 LPA
location
Chennai, Hyderabad+2

Hyderabad, Bangalore, Kochi

skills
  • devops
  • gcp
  • python
  • etl
  • docker
  • kubernates
  • bigquery
  • terraform
  • dataflow
Job Description
Job Title: GCP Data Engineer Employment Type: Permanent Industry of the Employer: IT / Software Services Department / Functional Area: Data Engineering, Cloud Engineering Job Description GREETINGS FROM HUCON Solutions Hiring for Leading MNC GCP Data Engineer Role: GCP Data Engineer Skills: GCP, Python, SQL, BigQuery, ETL Data Pipeline Experience: 59 Years Locations: Chennai, Kochi, Bangalore, Hyderabad, Pune Eligibility Criteria Strong hands-on experience in Python, Pandas, NumPy Expertise in SQL and solid understanding of Data Warehousing concepts In-depth knowledge of GCP Services including: BigQuery, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions Experience with Docker, Kubernetes, GitHub Strong communication and analytical skills Working experience with PySpark, Data Modeling, Dataproc, Terraform Google Cloud Professional Data Engineer certification is highly preferred Role Responsibilities Design, develop, and manage robust and scalable ETL / ELT pipelines on GCP using Dataflow, Cloud Run, BigQuery, Pub/Sub, and Cloud Composer Implement data ingestion workflows for structured and unstructured data sources Build and maintain data warehouses and data lakes using BigQuery, Cloud Storage, and other GCP tools Work with data modeling, architecture, and ETL/ELT frameworks Ensure best practices in performance, optimization, and cloud data management Keywords / Skills GCP, Python, SQL, BigQuery, ETL, Data Pipeline, Data Engineering, Cloud Run, Pub/Sub, Cloud Storage, Dataproc, Terraform, Kubernetes, Docker, Dataflow Total Experience: 5 to 9 Years Salary Type: Yearly Annual Salary Offered: As per company standards Job Type: Full Time Shift Type: Day Shift / Rotational (based on project requirement) Location of the Job: Chennai | Kochi | Bangalore | Hyderabad | Pune
INTERVIEW ASSURED IN 15 MINS
posted 2 months ago

AWS Data Engineer

CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
experience5 to 10 Yrs
Salary8 - 18 LPA
location
Chennai, Bangalore+2

Bangalore, Pune, Mumbai City

skills
  • athena
  • python
  • sql
  • aws
  • data engineering
  • data warehousing
  • etl
  • glue
  • s3
Job Description
AWS Data Engineer  Requirements  3+ year of experience working on AWS Cloud platform with strong experience in Python Knowledge on AWS services such as - AWS S3, Glue, API Gateway, Crawler, Athena, Cloudwatch, Lambda, EC2, Route53, IAM, Aurora/Dynamic DB, Redshift is an advantage Knowledge/experience on CI/CD deployment tools (CloudFormation, Terraform, Jenkins) Experience/knowledge with streaming technologies is must preferably Kafka Should have knowledge/experience with SQL Experience developing REST API Good analytical skills Knowledge or experience developing microservices Familiar working on Linux platforms Have good understanding on pros and cons and the cost impact of the AWS services being leveraged Good Communication skills
INTERVIEW ASSURED IN 15 MINS
question

Are these jobs relevant for you?

posted 1 week ago

Senior Snowflake Data Engineer

Hucon Solutions India Pvt.Ltd.
Hucon Solutions India Pvt.Ltd.
experience8 to 13 Yrs
Salary8 - 18 LPA
location
Chennai, Hyderabad+7

Hyderabad, Bangalore, Noida, Gurugram, Kolkata, Pune, Mumbai City, Delhi

skills
  • aws
  • sql
  • data modeling
  • snowflake
  • data build tool
  • five tran
Job Description
Senior Snowflake Data Engineer Location: PAN India Experience: 8+ Years Skills: Snowflake, dbt, FiveTran, Snowpipe, AWS (MWAA, S3, Lambda), GitHub CI/CD Job Description We are looking for an experienced Senior Snowflake Data Engineer with strong expertise in modern data warehousing, cloud technologies, and ELT pipeline development. The ideal candidate should have deep hands-on experience in Snowflake, dbt, cloud environments, and CI/CD practices, with the ability to design scalable and efficient data solutions. Key Responsibilities Analyze, integrate, model, and interpret large and complex datasets from multiple sources. Design and implement ELT data pipelines using dbt with Snowflake as the primary cloud data warehouse. Build efficient and scalable data transformation pipelines using dbt at an advanced level. Work with ETL/ELT and data governance tools such as FiveTran and Alation. Utilize advanced Snowflake features such as RBAC, Dynamic Tables, and various optimization techniques. Ensure strong data modelling and warehousing practices across diverse database technologies. Manage orchestrations using Apache Airflow or AWS MWAA, along with CI/CD pipelines. Oversee continuous deployment, monitoring, and operations of data solutions using GitHub Actions, Terraform, and other DevOps tools. Collaborate with technical and non-technical stakeholders through effective communication. Contribute to building future-state Data Warehouse capabilities using cutting-edge technologies. Adapt and work efficiently within Agile methodology. Preferred Qualifications 2+ years of hands-on experience with Snowflake as a Cloud Data Warehouse and Data Lake platform. Strong understanding of cloud environments, especially AWS (S3, Lambda, MWAA). Airline industry domain experience is a plus.
INTERVIEW ASSURED IN 15 MINS
posted 1 week ago

Data Engineer

Lorven Technologies Private Limited
experience6 to 10 Yrs
WorkRemote
location
Chennai, Bangalore+6

Bangalore, Noida, Kolkata, Gurugram, Pune, Mumbai City, Delhi

skills
  • azure
  • data engineering
  • data
  • bricks
  • factory
  • .net
  • python
Job Description
Data Engineer Azure Data Factory, SQL, Python, Databricks, ETL  Data Engineer .Net + Azure Data Factory  We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining data systems and architectures that support our business needs. This role requires expertise in working with large datasets, cloud technologies, and advanced data platforms to ensure the availability, quality, and accessibility of data for business analytics and decision-making. Key Responsibilities: Design, build, and maintain data pipelines to collect, process, and store data efficiently from various sources. Work with cross-functional teams to understand business requirements and deliver data solutions that meet the needs of the organization. Optimize data storage and retrieval methods to enhance system performance and data quality. Integrate data from multiple sources (databases, data lakes, cloud storage, etc.) to build comprehensive data sets. Build and maintain data infrastructure, ensuring it is scalable, reliable, and secure. Implement and manage data governance policies, ensuring data accuracy, consistency, and compliance. Conduct data modeling and provide insights into the data through advanced analytics tools and reports. Perform data transformations and data wrangling tasks to prepare data for analysis. Troubleshoot data issues and collaborate with stakeholders to resolve technical challenges. Ensure the integrity of data pipelines and systems by conducting routine testing and validation. Required Skills and Qualifications: Bachelors degree in Computer Science, Engineering, Information Systems, or related field. Proven experience as a Data Engineer or in a similar role, with a minimum of [X] years of experience. Proficiency in data engineering tools and technologies such as SQL, Python, Java, Scala, and ETL frameworks. Experience working with cloud platforms (AWS, Azure, GCP) and data storage solutions (e.g., Redshift, Snowflake, BigQuery). Solid understanding of data modeling, database design, and cloud data architectures. Hands-on experience with data warehousing concepts and tools (e.g., Apache Hive, Apache Spark). Familiarity with data orchestration tools such as Apache Airflow, Azure Data Factory. Knowledge of real-time data streaming technologies (e.g., Kafka, Kinesis) is a plus. Strong problem-solving skills and ability to troubleshoot complex data issues. Familiarity with data security best practices and data privacy regulations (e.g., GDPR, HIPAA).
INTERVIEW ASSURED IN 15 MINS
posted 2 months ago
experience3 to 7 Yrs
location
Madurai, Tamil Nadu
skills
  • ETL Tools
  • Project Management
  • Communication
  • Data Migration
  • Data Warehousing
  • Reporting
  • Team Collaboration
  • ERP Knowledge
Job Description
As a Project Manager/Project Lead in Data Management at our Madurai location, your role will involve the following key responsibilities: - **Key Requirements:** - Hands-on experience or working knowledge in Oracle E-Business Suite (EBS) or SAP projects. - Familiarity with ETL tools and data integration concepts. - **Project Management:** - Basic understanding of project management tools (e.g., MS Project, Jira, Trello). - Willingness to travel based on project or business requirements. - Strong verbal and written communication skills to coordinate with cross-functional teams and stakeholders. - **Preferred Qualifications:** - Experience managing data-related or ERP implementation projects. - Ability to manage timelines, risks, and deliverables effectively. - Exposure to data migration, data warehousing, or reporting environments. - Strong team collaboration skills and flexibility in working with onsite and remote teams.,
ACTIVELY HIRING
posted 2 months ago

Data Engineer III

PDI Technologies
experience5 to 9 Yrs
location
Chennai, Tamil Nadu
skills
  • SQL
  • Programming languages
  • Data warehousing
  • Snowflake
  • DBT
  • Cloud AWS
  • GCP
  • Azure
  • Project management
  • Communication
  • Leadership
  • Problemsolving
Job Description
As a Full Time Data Engineer III at PDI Technologies, you will be an integral part of our elite agile data services team, focusing on developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure for major global fortune 500 companies. Your role will involve coding data pipelines, administering databases, and collaborating with business users to fulfill their data requirements primarily using AWS, Snowflake, and DBT. Key Responsibilities: - Design and manage complex data architectures - Lead the development and optimization of data pipelines and ETL processes - Mentor junior engineers and provide technical guidance - Collaborate with cross-functional teams to understand and meet data requirements - Ensure the reliability and performance of data systems - Conduct data validation and quality assurance - Document data workflows and technical specifications - Participate in agile development processes - Implement industry standards and best practices - Maintain data security and compliance - Provide on-call support as required - Estimate and plan data engineering projects - Develop strategies for data storage, processing, and archiving - Troubleshoot and resolve complex data issues Qualifications: - Advanced SQL skills and proficiency in multiple programming languages - Extensive experience with data warehousing, specifically Snowflake - Proficiency in DBT (Data Build Tool) - Extensive experience in Cloud platforms like AWS, GCP, or Azure - Strong problem-solving and project management skills - Excellent communication and leadership abilities - Bachelors or masters degree in computer science, Information Technology, or a related field Preferred Qualifications: - Certifications such as Snowflake SnowPro Core Certification, dbt Certification, AWS Certified Data Analytics are a plus As part of PDI, you will be part of a global team committed to excellence, collaboration, and driving real impact. We value diversity, integrity, and growth. PDI offers a comprehensive benefits program, competitive salary, market-competitive benefits, and encourages a good work-life balance. Our global culture fosters diversity, inclusion, and values authenticity, trust, curiosity, and diversity of thought, ensuring a supportive environment for all.,
ACTIVELY HIRING
posted 1 week ago
experience5 to 9 Yrs
location
Coimbatore, Tamil Nadu
skills
  • DBT
  • Airflow
  • Data quality
  • SQL
  • Python
  • Data warehousing
  • Relational databases
  • Agile environment
  • Snowflake Data Architect
  • Airbyte
  • Kimball dimensional modeling
  • ETLELT pipelines
  • API integration
Job Description
As a Snowflake Data Architect at Aezion, Inc., your role will involve designing and implementing scalable data pipelines, integrating diverse data sources, and building a robust data warehouse to support business intelligence and analytics initiatives. Your key responsibilities will include: - Developing and maintaining ETL/ELT pipelines using Airbyte and Airflow. - Extracting data from multiple sources such as APIs, direct database connections, and flat files. - Ensuring data quality, consistency, and reliability across all ingestion processes. - Designing and implementing Kimball-style dimensional models in Snowflake. - Building and optimizing fact tables and dimension tables to support analytical workloads. - Collaborating with business teams to define and maintain the BUS Matrix for subject areas. - Using DBT to develop modular, testable, and version-controlled transformations. - Implementing data quality checks and documentation within DBT workflows. - Working closely with business stakeholders to understand requirements and translate them into technical solutions. - Ensuring compliance with data governance, security, and privacy standards. To be successful in this role, you will need the following skills and qualifications: - Strong proficiency in Snowflake architecture and performance tuning. - Hands-on experience with DBT, Airbyte, and Airflow. - Solid understanding of Kimball methodology for data warehousing. - Advanced SQL skills and familiarity with Python for ETL scripting. - Experience integrating data from APIs and relational databases. - Excellent communication and collaboration skills. - Ability to work in an agile environment and manage multiple priorities. Join Aezion, Inc. as a Snowflake Data Architect and be part of a leading custom software provider committed to transforming clients into lifelong partners through result-driven work.,
ACTIVELY HIRING
posted 1 month ago
experience5 to 9 Yrs
location
Coimbatore, Tamil Nadu
skills
  • data modeling
  • data analytics
  • SQL
  • data warehousing
  • business intelligence
  • agile methodologies
  • team coordination
  • ERWin diagrams
Job Description
As a Senior Data Modeler at our organization, you will play a crucial role in defining and evolving our data architecture and modeling practices. You will collaborate with cross-functional teams, mentor others, and contribute to the development of enterprise data models. **Key Responsibilities:** - Assist in establishing and maintaining information architecture best practices aligned with the organization's data strategy - Drive data modeling initiatives and contribute to the overall data architecture design and development - Develop and maintain conceptual, logical, and physical data models following industry standards - Capture and manage metadata within the enterprise data catalog for accurate documentation - Evaluate proposed data models in purchased applications and ensure compliance with standards - Educate stakeholders on data strategy principles to promote a strong data culture - Ensure compliance with security and regulatory policies in enterprise information architecture - Collaborate with stakeholders to design effective data models meeting evolving requirements - Participate in design reviews at different stages of the development lifecycle **Qualifications Required:** - A university degree equivalent to BS/MS in Computer Science, Life Sciences, or related field - 5+ years of experience as a Business Analyst with expertise in business process reengineering and user requirement gathering - Proficient in data modeling, ERWin diagrams, data analytics, SQL, data warehousing, and business intelligence practices - Strong communication skills in English In addition to the key responsibilities and qualifications, it would be nice to have experience in the pharmaceutical industry, agile methodologies, team coordination, and familiarity with Collibra.,
ACTIVELY HIRING
posted 3 weeks ago
experience4 to 8 Yrs
location
Chennai, All India
skills
  • sql
  • data warehousing
  • aws
  • cloud
  • hadoop
  • scala
  • java
  • python
  • data engineering
  • azure
  • data modeling
  • nosql
  • etl processes
  • pyspark
Job Description
As a Senior Data Engineer at our company, you will be responsible for designing, developing, and maintaining data pipelines for processing large-scale datasets. Your role will involve building efficient ETL workflows to transform and integrate data from multiple sources, as well as developing and optimizing Hadoop and PySpark applications for data processing. You will also play a key role in ensuring data quality, governance, and security standards are met across systems. Additionally, you will implement and manage Cloud-based data solutions using platforms such as AWS, Azure, or GCP. Collaboration with data scientists and analysts to support business intelligence initiatives will be an essential part of your responsibilities. Moreover, troubleshooting performance issues and optimizing query executions in big data environments will be part of your daily tasks. Staying updated with industry trends and advancements in big data and cloud technologies is crucial for this role. **Key Responsibilities:** - Design, develop, and maintain data pipelines for processing large-scale datasets. - Build efficient ETL workflows to transform and integrate data from multiple sources. - Develop and optimize Hadoop and PySpark applications for data processing. - Ensure data quality, governance, and security standards are met across systems. - Implement and manage Cloud-based data solutions (AWS, Azure, or GCP). - Collaborate with data scientists and analysts to support business intelligence initiatives. - Troubleshoot performance issues and optimize query executions in big data environments. - Stay updated with industry trends and advancements in big data and cloud technologies. **Qualifications Required:** - Strong programming skills in Python, Scala, or Java. - Hands-on experience with Hadoop ecosystem (HDFS, Hive, Spark, etc.). - Expertise in PySpark for distributed data processing. - Proficiency in ETL tools and workflows (SSIS, Apache Nifi, or custom pipelines). - Experience with Cloud platforms (AWS, Azure, GCP) and their data-related services. - Knowledge of SQL and NoSQL databases. - Familiarity with data warehousing concepts and data modeling techniques. - Strong analytical and problem-solving skills. If you are interested in this opportunity, please feel free to contact us at +91 7305206696 or email saranyadevib@talentien.com. As a Senior Data Engineer at our company, you will be responsible for designing, developing, and maintaining data pipelines for processing large-scale datasets. Your role will involve building efficient ETL workflows to transform and integrate data from multiple sources, as well as developing and optimizing Hadoop and PySpark applications for data processing. You will also play a key role in ensuring data quality, governance, and security standards are met across systems. Additionally, you will implement and manage Cloud-based data solutions using platforms such as AWS, Azure, or GCP. Collaboration with data scientists and analysts to support business intelligence initiatives will be an essential part of your responsibilities. Moreover, troubleshooting performance issues and optimizing query executions in big data environments will be part of your daily tasks. Staying updated with industry trends and advancements in big data and cloud technologies is crucial for this role. **Key Responsibilities:** - Design, develop, and maintain data pipelines for processing large-scale datasets. - Build efficient ETL workflows to transform and integrate data from multiple sources. - Develop and optimize Hadoop and PySpark applications for data processing. - Ensure data quality, governance, and security standards are met across systems. - Implement and manage Cloud-based data solutions (AWS, Azure, or GCP). - Collaborate with data scientists and analysts to support business intelligence initiatives. - Troubleshoot performance issues and optimize query executions in big data environments. - Stay updated with industry trends and advancements in big data and cloud technologies. **Qualifications Required:** - Strong programming skills in Python, Scala, or Java. - Hands-on experience with Hadoop ecosystem (HDFS, Hive, Spark, etc.). - Expertise in PySpark for distributed data processing. - Proficiency in ETL tools and workflows (SSIS, Apache Nifi, or custom pipelines). - Experience with Cloud platforms (AWS, Azure, GCP) and their data-related services. - Knowledge of SQL and NoSQL databases. - Familiarity with data warehousing concepts and data modeling techniques. - Strong analytical and problem-solving skills. If you are interested in this opportunity, please feel free to contact us at +91 7305206696 or email saranyadevib@talentien.com.
ACTIVELY HIRING
posted 2 months ago
experience5 to 9 Yrs
location
Chennai, Tamil Nadu
skills
  • Data Solutions
  • Data Engineering
  • ETL
  • Glue
  • Airflow
  • Programming Languages
  • Data Warehousing
  • DevOps
  • Data Cleansing
  • Data Monitoring
  • Data Engineer
  • Oracle PLSQL
  • PySpark
  • AWS S3
  • Data Modelling
  • Data Quality Testing
Job Description
Join our digital revolution in NatWest Digital X as a Data Engineer. In everything we do, we work towards making digital experiences effortless and secure. Organized around the principles of engineer, protect, and operate, we engineer simple solutions, protect customers, and operate smarter. Our approach allows our people to work differently based on their roles and needs, offering options like hybrid working and flexible hours to help them thrive. This role is based in India, requiring all normal working days to be carried out there. **Key Responsibilities:** - Collaborate with colleagues to build effortless, digital-first customer experiences - Develop innovative data-driven solutions to simplify the bank and ensure commercial success - Keep customers" and the bank's data safe and secure - Participate actively in the data engineering community and support the bank's strategic direction - Play a key role in driving value for customers by building data solutions - Build, maintain, test, and optimize a scalable data architecture - Carry out data extractions, transformations, and loading into data platforms - Develop comprehensive knowledge of the bank's data structures and metrics - Practice DevOps adoption in data engineering delivery - Collaborate closely with core technology and architecture teams - Develop a clear understanding of data platform cost levers - Source new data using appropriate tooling and integrate it into solutions **Qualifications Required:** - Good understanding of data usage and dependencies with wider teams and the end customer - Experience in ETL technical design, data quality testing, cleansing, monitoring, data warehousing, and data modeling - At least five years of experience in Oracle PL-SQL, PySpark, AWS S3, Glue, and Airflow - Proficiency in programming languages, data, and software engineering fundamentals - Knowledge of modern code development practices - Strong communication skills with the ability to engage with stakeholders proactively,
ACTIVELY HIRING
posted 4 days ago
experience6 to 13 Yrs
location
Chennai, Tamil Nadu
skills
  • Team management
  • Client handling
  • AWS
  • Data Engineering
  • SQL
  • Python
  • DWH
  • SLA tracking
  • failure resolution
  • Cloud technologies
Job Description
Job Description: You will be responsible for managing teams and handling clients, including tracking SLAs and resolving job failures efficiently. Your expertise in Cloud technologies, particularly AWS, will be crucial for this role. You must have a strong background in AWS Data Engineering pipelines, SQL, Python, and Data Warehousing. Additionally, you will collaborate with AWS/SRE/D3C development teams to ensure job schedules and SLAs are met within the AWS environment. Qualifications Required: - Minimum 6 to 13 years of experience - Team management and client handling skills - Excellent knowledge in Cloud technologies, especially AWS - Strong skills in AWS Data Engineering pipelines, SQL, Python, and Data Warehousing,
ACTIVELY HIRING
posted 5 days ago

Sr Data Analyst

Mako IT Lab
experience3 to 7 Yrs
location
Chennai, Tamil Nadu
skills
  • MS Excel
  • Python
  • data cleaning
  • data transformation
  • SQL
  • ETL
  • AWS
  • Azure
  • GCP
  • large datasets
Job Description
Role Overview: As a Data Engineer at MAKO, you will be responsible for building, managing, and optimizing data pipelines and datasets to support business and analytics teams. Your expertise in MS Excel, Python, and data cleaning will be crucial in delivering reliable and high-quality data. Key Responsibilities: - Design and maintain data pipelines and workflows. - Perform data cleaning, transformation, and validation of large datasets. - Create advanced reports using MS Excel (Pivot Tables, VLOOKUP, XLOOKUP, Power Query). - Write and maintain Python scripts for data automation and processing. - Optimize data storage and retrieval processes. - Ensure data accuracy, consistency, and integrity across multiple sources. - Collaborate with business analysts and stakeholders to understand data requirements. - Support ETL and data warehousing processes. Qualification Required: - Strong experience in MS Excel (advanced formulas, Pivot Tables, Power Query). - Strong knowledge of Python (Pandas, NumPy, data manipulation). - Hands-on experience with data handling, transformation, and cleaning. - Good knowledge of SQL (writing complex queries, joins, indexing). - Experience working with large datasets and structured/unstructured data. - Familiarity with ETL tools/processes. Additional Company Details (if present): MAKO IT Lab, founded in 2013, is a global software development company with a strong presence in the USA, UK, India, and Nepal. The company focuses on creating an empowering environment where individuals can take ownership, contribute innovative ideas, and grow through continuous learning and knowledge sharing. MAKO fosters long-term careers for its employees and encourages curiosity, initiative, and meaningful contributions to the company's journey.,
ACTIVELY HIRING
posted 2 months ago
experience3 to 7 Yrs
location
Chennai, Tamil Nadu
skills
  • SQL
  • Kafka
  • Mongo DB
  • data warehousing
  • Snowflake
  • data governance
  • data quality
  • Databricks
  • PySpark
  • ETL processes
  • Google Pub sub
  • cloud platforms
  • Google Cloud
Job Description
As a Data Engineer specializing in Databricks, your primary responsibility will be to develop, support, and drive end-to-end business intelligence solutions using Databricks. You will collaborate with business analysts and data architects to transform requirements into technical implementations. Your role will involve designing, developing, implementing, and maintaining PySpark code through the Databricks UI to facilitate data and analytics use cases for the client. Additionally, you will code, test, and document new or enhanced data systems to build robust and scalable applications for data analytics. You will also delve into performance, scalability, capacity, and reliability issues to identify and address any arising challenges. Furthermore, you will engage in research projects and proof of concepts to enhance data processing capabilities. Key Responsibilities: - Develop, support, and drive end-to-end business intelligence solutions using Databricks. - Collaborate with business analysts and data architects to transform requirements into technical implementations. - Design, develop, implement, and maintain PySpark code through the Databricks UI. - Code, test, and document new or enhanced data systems for robust and scalable applications. - Investigate performance, scalability, capacity, and reliability issues to address challenges. - Engage in research projects and proof of concepts to enhance data processing capabilities. Qualifications Required: - 3+ years of hands-on experience with Databricks and PySpark. - Proficiency in SQL and adept data manipulation skills. - Sound understanding of data warehousing concepts and technologies. - Familiarity with Google Pub sub, Kafka, or Mongo DB is a plus. - Knowledge of ETL processes and tools for data extraction, transformation, and loading. - Experience with cloud platforms such as Databricks, Snowflake, or Google Cloud. - Understanding of data governance and data quality best practices. Your expertise in Databricks and data engineering will play a crucial part in driving impactful business intelligence solutions and contributing to the growth and success of the organization.,
ACTIVELY HIRING
posted 2 months ago
experience5 to 9 Yrs
location
Chennai, Tamil Nadu
skills
  • ETL
  • Python
  • SQL
  • Data warehousing
  • AWS
  • Relational Databases
  • Oracle
  • PLSQL
  • Agile methodologies
  • SDLC
  • UNIX scripts
  • PySpark
  • Data lakes
  • Requirement Gathering Analysis
  • Big Data Hadoop
  • DB TWS
Job Description
As a Lead Data Engineer at Barclays, you will spearhead the evolution of the digital landscape, driving innovation and excellence by harnessing cutting-edge technology to revolutionize digital offerings and ensure unparalleled customer experiences. **Key Responsibilities:** - Strong knowledge of ETL and dependent technologies including Python, PySpark, and SQL - Extensive hands-on experience with PySpark and strong SQL knowledge - Understanding of Data warehousing and Data lakes - Proficiency in Requirement Gathering & Analysis and other SDLC phases - Experience with AWS, Big Data Hadoop, and Relational Databases like Oracle, SQL Server, and PL/SQL - Expertise in Agile methodologies, SDLC life cycles, processes, UNIX scripts, DB & TWS **Qualifications Required:** - Strong understanding of Data Warehousing concepts - Exposure to AWS working environment - Experience in Big Data technologies such as Hadoop - Proficiency in Relational Databases like Oracle, SQL Server, and PL/SQL - Knowledge of Agile methodologies, SDLC life cycles, and processes - Expertise in UNIX scripts, DB & TWS This role is based out of Pune. As a Lead Data Engineer, you will play a crucial role in facilitating and supporting Agile teams by ensuring adherence to Scrum principles. Your responsibilities will include facilitating events, supporting iteration execution, optimizing flow, mitigating risks, building high-performing teams, stakeholder management, governance, and reporting. Joining Barclays as a Lead Data Engineer, you are expected to advise and influence decision-making, contribute to policy development, and ensure operational effectiveness. You will lead a team performing complex tasks, set objectives, coach employees, and demonstrate clear leadership behaviors. Your role will involve collaborating closely with other functions and business divisions, identifying ways to mitigate risk, and developing new policies and procedures to support the control and governance agenda. All colleagues at Barclays are expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship, as well as the Barclays Mindset of Empower, Challenge, and Drive.,
ACTIVELY HIRING
posted 3 weeks ago
experience8 to 12 Yrs
location
Chennai, Tamil Nadu
skills
  • Python
  • SQL
  • Snowflake
  • Data Engineering
  • Data Modeling
  • Data Warehousing
  • Containerization
  • Data Integration
  • Orchestration
  • Messaging
  • Technical Leadership
  • Mentoring
  • Golang
  • Databricks
  • BigQuery
  • Cloud Data Platforms
  • CICD Pipelines
  • Infrastructure as Code
  • Analytics BI
  • AIML
  • Cloud Storage Integration
  • Data Observability
  • Quality Frameworks
  • Governance Controls
Job Description
Role Overview: As a Principal Software Engineer - Data, your role will be to act as a hands-on technical leader and a key communicator with stakeholders as part of the Data Products team. You will directly contribute to designing and developing enterprise-grade data systems while serving as a bridge between engineering teams and business partners. Key Responsibilities: - Drive development efforts by contributing high-quality, scalable, and maintainable code across data pipelines, APIs, and platform components. - Own the communication of project deliverables, timelines, and risks to internal and external stakeholders to ensure alignment at every step. - Understand customer needs and translate them into technical solutions, partnering closely with product, analytics, and engineering teams. - Design and deliver robust and future-proof data architectures supporting analytics, APIs, and machine learning initiatives. - Lead the technical execution of key projects, ensuring clear communication of progress and proactive resolution of roadblocks. - Co-develop architectural roadmaps, implementation plans, and go-live strategies cross-functionally to meet business requirements. - Participate in stakeholder reviews and provide updates on technical progress, dependencies, and constraints. - Guide platform-level optimization, including cost efficiency, performance, reliability, and maintainability. - Set best practices for data governance, lineage, quality, and security in a distributed data environment. - Mentor engineers to foster a strong technical culture and continuous learning environment. Qualifications Required: - 8-12 years of development experience in data engineering, with direct contribution to 24x7 production systems. - Advanced skills in Python and/or Golang, SQL, and current cloud data platforms such as Databricks, BigQuery, Snowflake, etc. - Strong experience in communicating complex project plans and deliverables to both technical and business audiences. - Experience in developing and operating scalable data pipelines, APIs, and data platform components in real-world environments. - Deep understanding of batch and real-time data architectures, data modeling, and data warehousing. - Hands-on experience with cloud-native ecosystems like GCP, AWS, or Azure, CI/CD pipelines, and infrastructure as code. - Proficiency in setting up data observability, quality frameworks, and governance controls in distributed systems. - Demonstrated success in stakeholder engagement, influencing outcomes, and building long-term trust. - Technical leadership in prior roles with clear contributions to architecture, development, and delivery. - Mentoring experience and a passion for helping others grow technically and professionally.,
ACTIVELY HIRING
posted 6 days ago
experience18 to 22 Yrs
location
Chennai, Tamil Nadu
skills
  • Snowflake
  • pricing
  • data engineering
  • analytics
  • personalization
  • pricing optimization
  • Databricks
  • product catalogue platforms
  • AIML
  • architecture
  • solution design
  • AIML use cases
  • catalogue management
  • data pipelines
  • scalable architectures
Job Description
As an experienced professional in the IT services industry with a background in data warehousing and big data engineering, you have progressed into an architect role with expertise in Snowflake and Databricks. You now hold a leadership position focused on end-to-end delivery within the retail/ecommerce domain, particularly in pricing and product catalogue platforms. Your responsibilities include leading and managing a 20-member delivery team encompassing data engineering, AI/ML, and analytics. Key Responsibilities: - Own program delivery for Data & AI initiatives, ensuring quality, timelines, and measurable business impact. - Utilize deep knowledge of Snowflake and Databricks to guide architecture and solution design. - Drive AI/ML use cases in retail/ecommerce, such as personalization, pricing optimization, and catalogue management. - Ensure the development of robust data pipelines and scalable architectures for high-volume retail platforms. - Collaborate with senior stakeholders to align delivery outcomes with business priorities. Qualifications Required: - Minimum of 18 years in IT services with a strong career progression from data warehousing/big data engineer to architect to delivery leader with a focus on AI. - Hands-on expertise in Snowflake, Databricks, and modern data platforms. - Currently working in the Retail/ecommerce domain, specifically in pricing and product catalogue platforms. Please note: The job description does not include any additional details about the company.,
ACTIVELY HIRING
posted 2 months ago

Lead Data Engineer

ResourceTree Global Services Pvt Ltd
experience4 to 8 Yrs
location
Chennai, Tamil Nadu
skills
  • AWS
  • Python
  • Datastage
  • Informatica
  • SSIS
  • SQL
  • Talend
  • DBT
  • SQL Server
  • Oracle
  • MySQL
  • PostgreSQL
  • MongoDB
  • Cassandra
  • Snowflake
  • Hadoop
  • Spark
  • Kafka
  • Azure
  • Data Modeling
  • Data Warehousing
  • BI Tools
  • ETL Concepts
  • Data Integration Tool
  • Informatica IICS
  • Databricks
  • RedShift
  • Azure SQL
  • AWS Redshift
  • Google Cloud
Job Description
As a Lead Data Engineer specializing in AWS RedShift, your role will involve leading the design, development, and optimization of scalable ETL/ELT pipelines. You will be responsible for ensuring efficient data integration and driving critical business intelligence and analytics initiatives. Your deep expertise in AWS RedShift, including architecture, query performance tuning, and workload optimization, will be crucial in troubleshooting complex data challenges and driving performance improvements. Your passion for continuous learning and problem-solving will enable data-driven decision-making within the organization. **Key Responsibilities:** - Lead the design and architecture of scalable data integration solutions on-premise and in the cloud, ensuring alignment with business requirements and industry standards. - Engage with executive leadership and stakeholders to understand business needs and translate them into technical solutions. - Define data models, schemas, and structures to optimize data storage, retrieval, and processing for analytical workloads. - Provide technical guidance, mentorship, and support to a team of data engineers. - Plan, prioritize, and manage data engineering projects, tasks, and timelines. - Design, develop, and maintain data integration pipelines and ETL/ELT workflows. - Lead multiple projects or manage larger teams with sub-tracks. **Qualifications Required:** - Proficiency in basic and advanced SQL. - Strong skills in Python for data integration and engineering tasks. - Experience with ETL/ELT tools such as Informatica, Talend, DataStage, SSIS, DBT, Databricks, or equivalent. - Knowledge of relational databases (SQL Server, Oracle, MySQL, PostgreSQL), NoSQL databases (MongoDB, Cassandra), and cloud databases (RedShift, Snowflake, Azure SQL). - Familiarity with big data technologies like Hadoop, Spark, Kafka, and cloud platforms such as AWS, Azure, or Google Cloud. - Solid understanding of data modeling, data warehousing concepts, and practices. - Experience in data profiling, data validation, requirements gathering, documentation processes, and unit testing. - Knowledge of BI tools is an added advantage. - Aptitude for logical reasoning, analytical skills, and willingness to learn and take initiatives. - Ability to adapt to a fast-paced Agile environment. The company is looking for a Lead Data Engineer with a minimum of 8 years of experience in ETL/ELT, preferably with 4+ years of hands-on experience in AWS RedShift. Strong proficiency in AWS Redshift, writing complex SQL queries, programming in Python, and experience with version control tools like Git and CI/CD workflows are essential. Prior exposure to data lakes and big data technologies would be beneficial for this role.,
ACTIVELY HIRING
posted 2 weeks ago
experience3 to 7 Yrs
location
Chennai, Tamil Nadu
skills
  • DevOps
  • Data warehousing
  • data integration
  • ETL tools
  • Talend
  • SQL
  • PLSQL
  • optimization
  • relational databases
  • PostgreSQL
  • Oracle
  • Microsoft SQL Server
  • MySQL
  • NoSQL
  • MongoDB
  • Python
  • JavaScript
  • Java
  • Scala
  • Foundry
  • Palantir
  • Ontology
  • Data Engineering
  • Analytics
  • Reporting
  • Microsoft Azure
  • AWS
  • Snowflake
  • Infrasturcure as a code
  • DataOps
  • MLOps
  • data modelling
  • SQL query tuning
  • documentbased databases
  • Pyspark
  • enterprise information strategy solutions
  • datacentric solutions
  • data governance solutions
  • data pipeline architecture
  • internal process improvements
  • health checks
  • Foundry Tools
  • Contour
  • Objectexplorer
  • OntologyManager
  • Objecteditor
  • Actions
  • Typescript
  • Code workbook
  • Code Repository
  • Foundry ML
  • Cloud Data Analytics Platform
  • viable architectures
  • Google
  • Generative AI
Job Description
Role Overview: At Capgemini Invent, you will be part of a team that believes in driving change through inventive transformation. You will blend your strategic, creative, and scientific capabilities to collaborate closely with clients and deliver cutting-edge solutions. Your role will involve driving transformation tailored to our client's challenges of today and tomorrow, informed and validated by science and data, and superpowered by creativity and design, all underpinned by technology created with purpose. Key Responsibilities: - Design, create, and maintain an optimal data pipeline architecture in Foundry - Identify, design, and implement internal process improvements in Foundry - Schedule jobs for pipeline in Palantir, monitor data pipeline health, and configure health checks and alerts - Have a good understanding and working knowledge of Foundry Tools such as Ontology, Contour, Object-explorer, Ontology-Manager, Object-editor using Actions/Typescript, Code workbook, Code Repository, Foundry ML - Be responsible for architecture topics and solution scenarios in the areas of Cloud Data Analytics Platform, Data Engineering, Analytics, Reporting, and designing viable architectures based on Palantir, Microsoft Azure, AWS, Snowflake, Google (or similar) and implementing analytics Qualifications Required: - Experience in DevOps, Infrastructure as code, DataOps, MLOps, data warehousing, data modeling, and data integration for enterprise data environments - Experience with ETL tools primarily Talend and/or any other Data Integrator tools (open source/proprietary) - Extensive experience with SQL and SQL scripting (PL/SQL & SQL query tuning and optimization) for relational databases such as PostgreSQL, Oracle, Microsoft SQL Server, and MySQL, as well as on NoSQL like MongoDB and/or document-based databases - Experience in programming languages like Python, Pyspark, JavaScript, Java/Scala etc. - Provide data services for enterprise information strategy solutions, working with business solutions leaders and teams to collect and translate information requirements into data to develop data-centric solutions - Design and develop modern enterprise data-centric solutions (e.g. Palantir, DWH, Data Lake, Data Lakehouse) - Responsible for designing data governance solutions Additional Details: Capgemini is a global business and technology transformation partner with a responsible and diverse group of 340,000 team members in more than 50 countries. With a strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. The company delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market-leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem. You will appreciate the significance of flexible work arrangements and career growth opportunities provided here, along with the chance to equip yourself with valuable certifications in the latest technologies such as Generative AI.,
ACTIVELY HIRING
posted 1 week ago
experience10 to 14 Yrs
location
Chennai, Tamil Nadu
skills
  • Informatica PowerCenter
  • Oracle
  • DB2
  • PLSQL
  • SQL
  • Data Modeling
  • Data Warehousing
  • Performance Tuning
  • ETL
  • Data Governance
  • Customer Interaction
  • Data Architecture
  • Presales
  • Database Management
  • Warehousing
  • Client Management
  • Informatica IDMC
  • Data Quality Management
  • Cloud Platforms
  • Data Documentation
  • RealTime Data Processing
Job Description
As an Informatica Manager at EY-GDS D&A (Data and Analytics) team, your role involves overseeing data integration projects, leading a team, designing data integration architectures, developing ETL processes, and optimizing performance. You will work with Informatica PowerCenter, IDMC, Oracle, DB2, PL/SQL, and SQL technologies to deliver impactful solutions in various industries like Banking, Insurance, Manufacturing, Healthcare, Retail, Supply Chain, and Finance. **Key Responsibilities:** - **Project Management:** - Oversee planning, execution, and delivery of data integration projects using Informatica tools. - Define project scope, objectives, and deliverables in coordination with stakeholders. - **Team Leadership:** - Manage and guide a team, fostering a collaborative environment for knowledge sharing. - **Architecture and Design:** - Design and implement data integration architectures meeting business requirements. - Analyze existing data structures to design ETL processes and data warehouse structures. - **Development and Implementation:** - Create, maintain, and optimize ETL processes, stored procedures, functions, and database structures. - Perform advanced ETL development using Informatica, PL/SQL, and Oracle Database tuning. - **Performance Tuning:** - Monitor and optimize the performance of ETL processes and data workflows. - Identify and resolve performance bottlenecks to ensure efficient data movement. - **Data Quality Management:** - Implement data quality checks to ensure data accuracy and integrity. - Make recommendations for system changes based on data profiling and analysis. - **Collaboration with IT and Business Teams:** - Work closely with IT and business teams in designing and implementing the data warehouse. - Collaborate with subject matter experts to understand data behavior and characteristics. - **Documentation and Reporting:** - Use data modeling and documentation tools to analyze and present data analysis work. - Maintain documentation of data integration processes, workflows, and architecture. - **Training and Support:** - Provide training and support on Informatica tools to end-users and team members. - Act as a point of contact for troubleshooting data integration issues. - **Continuous Improvement:** - Stay updated with the latest data integration technologies and propose process improvements. **Qualifications Required:** - **Education:** BE/BTech/MCA with 10+ years of IT development experience. - **Informatica Expertise:** Proven experience in designing and implementing solutions using Informatica tools. - **Cloud Platform Experience:** Hands-on experience with public cloud platforms for data integration. - **Regulatory Knowledge:** Strong understanding of Data Governance frameworks and compliance regulations. - **Data Documentation:** Experience in producing Data Lineage Reports and Business Glossaries. - **Data Integration Experience:** 5+ years of experience in data integration solutions. - **Real-Time Data Processing:** Exposure to real-time data processing methodologies within the Informatica ecosystem. - **Customer Interaction:** Ability to manage customer interactions effectively. - **Data Management Knowledge:** In-depth knowledge of Data Architecture and Data Modeling. - **Database and Warehousing Experience:** Experience with databases, data warehousing, and high-performance computing environments. - **Presales and Presentations:** Experience in responding to RFPs and delivering customer presentations. - **Domain Experience:** Nice to have experience in Insurance and Finance domains. Join EY to work on inspiring projects, receive support and coaching from engaging colleagues, and have opportunities for skill development and career progression in a collaborative environment focused on high quality and knowledge exchange.,
ACTIVELY HIRING
logo

@ 2025 Shine.com | All Right Reserved

Connect with us:
  • LinkedIn
  • Instagram
  • Facebook
  • YouTube
  • Twitter