Cloud Data Architect (FinTech)
Data Engineer Job At Capgemini
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
YOUR TEAM:
You will be a part of our Insights & Data practice, and member of a team that delivers cutting-edge data centric solutions. Most of our projects are Cloud & Big Data engineering. We develop solutions to process large, also unstructured, datasets, with custom build Cloud Data services on AWS, Azure or GCP. We are in charge of for full SDLC of the solution: apart from using data processing tools (eg, ETL), we code a lot in Python, Scala or Java and use DevOps tools and best practices. The data is either exposed to downstream systems via API, outbound interfaces or visualized on reports and dashboards. Within our AI CoE we deliver Data Science and Machine Learning projects with focus on NLP, Anomaly Detection and Computer Vision.
YOUR TASKS:
* Creating architecture for systems processing large and unstructured datasets (Data Lake Architecture, Streaming Architecture);
* Designing modern DWH / Big Data solutions in the cloud and in the Continuous Delivery / Continuous Integration environment.
* Data model design, data flow documentation.
* Supporting the Team as a Technical Leader, ensuring system compliance with standards and best practices in software development.
YOUR PROFILE:
* 3 years of experience as an Architect and/or Technical Leader in Cloud or Big Data projects in the field of data processing and visualization (in different phases of SDLC);
* Practical knowledge of one of the following clouds: AWS, Azure, GCP in the area of Storage, Compute (+Serverless), Networking and Devops supported by work on commercial projects;
* Familiarity with at least few of the following technologies: Cloud Dataflow, BigQuery, Cloud Dataproc, Cloud KMS, Pub/Sub, Google Kubernetes Engine, Apache Beam, Kafka, Spark, Snowflake, Data Lake Gen2, Event Hub, Data Factory, Databricks, Azure DWH, Azure Function, Power BI, Terraform, Redshift, Glue, Athena, Kinesis, Lambda;
* At least basic command of one of the programming languages: Python, Scala, java, bash;
WHAT YOU'LL LOVE ABOUT WORKING HERE:
* Practical benefits: yearly financial bonus, private medical care with Medicover with additional packages (e.g., dental, senior care, oncology) available on preferential terms, life insurance and access to NAIS benefit platform.
* Access to over 70 training tracks with certification opportunities (e.g., GenAI, Excel, Business Analysis, Project Management) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, Pluralsight, TED Talks, Coursera and Udemy Business materials and trainings.
* Cutting-Edge Technology: Position yourself at the forefront of IT innovation, working with the latest technologies and platforms. Capgemini partners with top global enterprises, including 145 Fortune 500 companies.
* Enjoy hybrid working model that fits your life - after completing onboarding, connect work from a modern office with ergonomic work from home, thanks to home office package
GET TO KNOW US:
Capgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued. Do you want to get to know us better? Check our Instagram - @capgeminipl or visit our Facebook profile - Capgemini Polska. You can also find us on TikTok! - @capgeminipl.
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of nearly 350,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group reported 2022 global revenues of €22 billion. Get the Future You Want | *****************
Senior Data Engineer
Houston, TX Jobs
Senior Data Engineer / Data Analytics Engineer - Full Remote Working from anywhere in the US
SQL+Python+ETL+ Apache Airflow
Our client is a global leading and fast growing high tech company:
-Over 6,500 employees across 20+ offices;
-300 Million+ active users on some of the platforms they developed;
-Cutting edge AR and VR technologies, 3D printing, etc.
They are looking for a senior Data Engineer to join their FinTech team!
You will develop scalable data pipelines, ensure data quality, and support business decision-making with high-quality datasets.
-Work across technology stack: SQL, Python, ETL, Big Query, Spark, Hadoop, Git, Apache Airflow, Data Architecture, Data Warehousing
-Design and develop scalable ETL pipelines to automate data processes and optimize delivery
-Implement and manage data warehousing solutions, ensuring data integrity through rigorous testing and validation
-Lead, plan and execute workflow migration and data orchestration using Apache Airflow
-Focus on data engineering and data analytics
Requirements:
-5+ years of experience in SQL
-5+ years of development in Python
-MUST have strong experience in Apache Airflow
-Experience with ETL tools, data architecture, and data warehousing solutions
-Strong communication skills
W2 employer full time contract, initially till the end of 2025 with the option to extend yearly. Offer $65 to $75 an hour depending on experience (40 hours per week, Mon-Fri) plus 50% contribution to medical plan, sick leave and federal public holidays as PTOs. Full remote working from anywhere in the US.
Data Scientist - Washington DC (NoVa) TS/SCI Cleared
Alexandria, VA Jobs
About Us
We are a leading analytics company leveraging AI to empower enterprises and government agencies with smarter, faster decision-making capabilities. Our innovative platform turns intricate data into practical insights with intuitive AI tools and advanced visualization capabilities, empowering users to make informed decisions seamlessly. Trusted by top defense agencies and Fortune 500 companies, we're scaling fast and looking for a Data Scientist (TS/SCI Cleared) to join our dynamic team.
What You'll Do:
Design, implement, and deliver AI-powered solutions tailored to customer needs using our advanced analytics tools.
Work closely with clients to guide AI solutions from initial concept through full-scale deployment.
Leverage big data tools and platforms, such as Databricks, to build scalable and efficient AI-driven solutions.
What You'll Bring:
Active TS/SCI security clearance and ability to work from an SCIF.
Based in Washington DC/Northern Virginia, with travel to client sites.
Degree in Computer Science or related field.
3+ years of Python coding (pandas, numpy, sklearn, TensorFlow, PyTorch, etc.).
Experience deploying machine learning models in production.
Proficiency with SQL/NoSQL databases, version control (e.g., Git), Docker, and Kubernetes.
Strong ownership, accountability, and communication skills.
Bonus Points For:
Experience leading projects in SCIF environments.
Cyber Analytics, PCAP, or network monitoring expertise.
Familiarity with Spark, Dask, Snowpark, Kafka, or task schedulers like Airflow and Celery.
Join us and be part of a mission-driven team at the forefront of AI innovation!
Senior Data Engineer
Mountain View, CA Jobs
We are looking for an experienced Data Software Engineer to spearhead the development and optimization of distributed data systems. In this role, you will architect and manage structured and NoSQL data systems, design relational databases, and optimize performance for large-scale data operations. The ideal candidate will be a hands-on NodeJS Engineer with extensive experience in data queries.
Responsibilities:
Design, develop, and maintain back-end systems for web applications using Node.js
Managing Structured Data Systems (defining fixed formats and general data structures that will apply to multiple data sets)
Architecting and Designing Relational and NoSQL data structures
Collaborate with front-end developers and back-end developers to build efficient ETL pipelines and ensure seamless integration
Requirements:
8+ years of experience as a Full Stack or Back End Engineer
Strong proficiency with NodeJS
Expert knowledge of databases and SQL; no SQL and relational databases, Postgres
Knowledgeable of design and architecture of data systems
Familiar with working with the AWS platform
Experience with ETL pipeline creation and management
Proficiency with Git and GitHub workflows
Experience writing unit tests
Bachelor degree (or equivalent) in computer science, engineering, or similar field
Location: Mountain View, CA (hybrid onsite schedule)
Type: Full-time
Salary Range: $190-220k (DOE)
Submit resume to ***********************
Senior Data Engineer
Fremont, CA Jobs
About Us
We're on a mission to redefine how AI interacts with the world-bringing human-like understanding, perception, and communication to the forefront of technology. Our cutting-edge research in multi-modal AI powers everything from text-to-video AI avatars to real-time interactive experiences that are reshaping industries like healthcare, education, sales, and beyond.
Backed by top investors, we're rapidly scaling and looking for exceptional talent to push the boundaries of AI-driven communication. If you're ready to own data strategy at a high-growth AI company, this is your chance to make an impact.
The Role: Data Architect, Builder, and Innovator
Data isn't just fuel for our AI-it's the foundation of everything we build. As Senior Data Engineer, you won't just clean datasets and maintain pipelines. You'll own the entire data lifecycle, from sourcing and structuring to optimizing for next-gen AI models.
We're looking for someone who thinks beyond conventional data engineering-you anticipate what's next, push boundaries, and make sure our AI has access to the best data possible.
Your Mission 🚀
Be a data visionary - You see beyond the present and anticipate the data needs of future AI models, ensuring high-quality, diverse, and structured datasets that drive innovation.
Own data end-to-end - You don't just process data-you strategically source, structure, and optimize multimodal datasets (text, video, images, and more) for maximum AI effectiveness.
Shape AI model training - Work closely with ML engineers to curate and fine-tune datasets that elevate AI performance, efficiency, and inference accuracy.
Be a data hunter - Whether it's web scraping, third-party integrations, or unconventional sources, you know how to acquire the right data and scale data procurement.
Master video data - AI-generated video presents unique challenges. You'll define classification, segmentation, and structuring techniques to optimize video datasets for AI training.
Optimize labeling & automation - Develop automated pipelines that make data cleaning, labeling, and structuring seamless while maintaining gold-standard quality.
Turn internal data into insights - Our own platform is a goldmine of information. You'll uncover, organize, and optimize internal data for strategic impact.
Move fast, but don't break data - You balance speed and precision, ensuring every pipeline, dataset, and workflow is scalable, reliable, and built to last.
What We're Looking For ⚡
You don't just maintain-you build. From zero to fully running pipelines, you make things happen. You take charge of how we leverage data for AI-driven decisions.
Extreme ownership - You don't wait for someone to tell you what data we need. You proactively identify, source, and structure data for AI breakthroughs.
Product-minded approach - You understand the bigger picture and align data strategies with company goals.
Experience with multimodal AI data - Background in LLMs, video, text, and image data is a huge plus.
Automation first - You know how to automate data cleaning, structuring, and labeling to ensure efficiency and scale.
ML-first mindset - You get that better data = better models and optimize datasets for maximal AI impact.
Technical expertise - You've got Python, SQL, and large-scale data processing tools locked down.
Speed + accuracy - You move fast but never compromise on precision.
You set the standard - We're solving problems no one has solved before. You create best practices, not just follow them.
Why Join Us?
When you join our team, you're joining a fast-moving, diverse, and collaborative environment where your work has direct impact. We offer:
Flexible work schedules & remote-friendly culture
Unlimited PTO & top-tier healthcare
Generous gear stipends
A high-energy, supportive team that loves what they do
We aren't just looking for someone to fit in-we want culture creators who bring new perspectives and push boundaries. If you're ready to take data engineering to the next level and drive the future of human-AI interaction, let's talk. 🚀
Apply now and be part of the AI revolution!
Senior Data Engineer
San Francisco, CA Jobs
About Us
We're on a mission to redefine how AI interacts with the world-bringing human-like understanding, perception, and communication to the forefront of technology. Our cutting-edge research in multi-modal AI powers everything from text-to-video AI avatars to real-time interactive experiences that are reshaping industries like healthcare, education, sales, and beyond.
Backed by top investors, we're rapidly scaling and looking for exceptional talent to push the boundaries of AI-driven communication. If you're ready to own data strategy at a high-growth AI company, this is your chance to make an impact.
The Role: Data Architect, Builder, and Innovator
Data isn't just fuel for our AI-it's the foundation of everything we build. As Senior Data Engineer, you won't just clean datasets and maintain pipelines. You'll own the entire data lifecycle, from sourcing and structuring to optimizing for next-gen AI models.
We're looking for someone who thinks beyond conventional data engineering-you anticipate what's next, push boundaries, and make sure our AI has access to the best data possible.
Your Mission 🚀
Be a data visionary - You see beyond the present and anticipate the data needs of future AI models, ensuring high-quality, diverse, and structured datasets that drive innovation.
Own data end-to-end - You don't just process data-you strategically source, structure, and optimize multimodal datasets (text, video, images, and more) for maximum AI effectiveness.
Shape AI model training - Work closely with ML engineers to curate and fine-tune datasets that elevate AI performance, efficiency, and inference accuracy.
Be a data hunter - Whether it's web scraping, third-party integrations, or unconventional sources, you know how to acquire the right data and scale data procurement.
Master video data - AI-generated video presents unique challenges. You'll define classification, segmentation, and structuring techniques to optimize video datasets for AI training.
Optimize labeling & automation - Develop automated pipelines that make data cleaning, labeling, and structuring seamless while maintaining gold-standard quality.
Turn internal data into insights - Our own platform is a goldmine of information. You'll uncover, organize, and optimize internal data for strategic impact.
Move fast, but don't break data - You balance speed and precision, ensuring every pipeline, dataset, and workflow is scalable, reliable, and built to last.
What We're Looking For ⚡
You don't just maintain-you build. From zero to fully running pipelines, you make things happen. You take charge of how we leverage data for AI-driven decisions.
Extreme ownership - You don't wait for someone to tell you what data we need. You proactively identify, source, and structure data for AI breakthroughs.
Product-minded approach - You understand the bigger picture and align data strategies with company goals.
Experience with multimodal AI data - Background in LLMs, video, text, and image data is a huge plus.
Automation first - You know how to automate data cleaning, structuring, and labeling to ensure efficiency and scale.
ML-first mindset - You get that better data = better models and optimize datasets for maximal AI impact.
Technical expertise - You've got Python, SQL, and large-scale data processing tools locked down.
Speed + accuracy - You move fast but never compromise on precision.
You set the standard - We're solving problems no one has solved before. You create best practices, not just follow them.
Why Join Us?
When you join our team, you're joining a fast-moving, diverse, and collaborative environment where your work has direct impact. We offer:
Flexible work schedules & remote-friendly culture
Unlimited PTO & top-tier healthcare
Generous gear stipends
A high-energy, supportive team that loves what they do
We aren't just looking for someone to fit in-we want culture creators who bring new perspectives and push boundaries. If you're ready to take data engineering to the next level and drive the future of human-AI interaction, let's talk. 🚀
Apply now and be part of the AI revolution!
Senior Data Engineer
Santa Rosa, CA Jobs
About Us
We're on a mission to redefine how AI interacts with the world-bringing human-like understanding, perception, and communication to the forefront of technology. Our cutting-edge research in multi-modal AI powers everything from text-to-video AI avatars to real-time interactive experiences that are reshaping industries like healthcare, education, sales, and beyond.
Backed by top investors, we're rapidly scaling and looking for exceptional talent to push the boundaries of AI-driven communication. If you're ready to own data strategy at a high-growth AI company, this is your chance to make an impact.
The Role: Data Architect, Builder, and Innovator
Data isn't just fuel for our AI-it's the foundation of everything we build. As Senior Data Engineer, you won't just clean datasets and maintain pipelines. You'll own the entire data lifecycle, from sourcing and structuring to optimizing for next-gen AI models.
We're looking for someone who thinks beyond conventional data engineering-you anticipate what's next, push boundaries, and make sure our AI has access to the best data possible.
Your Mission 🚀
Be a data visionary - You see beyond the present and anticipate the data needs of future AI models, ensuring high-quality, diverse, and structured datasets that drive innovation.
Own data end-to-end - You don't just process data-you strategically source, structure, and optimize multimodal datasets (text, video, images, and more) for maximum AI effectiveness.
Shape AI model training - Work closely with ML engineers to curate and fine-tune datasets that elevate AI performance, efficiency, and inference accuracy.
Be a data hunter - Whether it's web scraping, third-party integrations, or unconventional sources, you know how to acquire the right data and scale data procurement.
Master video data - AI-generated video presents unique challenges. You'll define classification, segmentation, and structuring techniques to optimize video datasets for AI training.
Optimize labeling & automation - Develop automated pipelines that make data cleaning, labeling, and structuring seamless while maintaining gold-standard quality.
Turn internal data into insights - Our own platform is a goldmine of information. You'll uncover, organize, and optimize internal data for strategic impact.
Move fast, but don't break data - You balance speed and precision, ensuring every pipeline, dataset, and workflow is scalable, reliable, and built to last.
What We're Looking For ⚡
You don't just maintain-you build. From zero to fully running pipelines, you make things happen. You take charge of how we leverage data for AI-driven decisions.
Extreme ownership - You don't wait for someone to tell you what data we need. You proactively identify, source, and structure data for AI breakthroughs.
Product-minded approach - You understand the bigger picture and align data strategies with company goals.
Experience with multimodal AI data - Background in LLMs, video, text, and image data is a huge plus.
Automation first - You know how to automate data cleaning, structuring, and labeling to ensure efficiency and scale.
ML-first mindset - You get that better data = better models and optimize datasets for maximal AI impact.
Technical expertise - You've got Python, SQL, and large-scale data processing tools locked down.
Speed + accuracy - You move fast but never compromise on precision.
You set the standard - We're solving problems no one has solved before. You create best practices, not just follow them.
Why Join Us?
When you join our team, you're joining a fast-moving, diverse, and collaborative environment where your work has direct impact. We offer:
Flexible work schedules & remote-friendly culture
Unlimited PTO & top-tier healthcare
Generous gear stipends
A high-energy, supportive team that loves what they do
We aren't just looking for someone to fit in-we want culture creators who bring new perspectives and push boundaries. If you're ready to take data engineering to the next level and drive the future of human-AI interaction, let's talk. 🚀
Apply now and be part of the AI revolution!
Senior Data Engineer
Sunnyvale, CA Jobs
Hi,
Job Title: Senior Data Engineer
Duration: Contract to Hire Role
Interview Process: Onsite
Payrate: 75 to 80/hr. on C2C
Responsibilities:
Key Responsibilities:
Design, develop, and maintain data pipelines using Spark, PySpark, and other big data technologies to process large datasets.
Build and optimize complex SQL queries for data extraction, transformation, and loading (ETL) in both batch and real-time workflows.
Work with cloud platforms such as AWS, Azure, or GCP to deploy and manage data infrastructure.
Collaborate with cross-functional teams to gather data requirements and deliver data solutions that meet business needs.
Ensure data quality, integrity, and consistency across different stages of data processing.
Optimize and troubleshoot performance of Spark and SQL-based applications.
Develop and implement data models and data architectures to support analytics and business intelligence initiatives.
Create and maintain automated data workflows and ensure they are scalable and maintainable.
Document data processes, architectures, and pipelines to ensure knowledge sharing across teams.
Required Skills & Qualifications:
Proven experience as a Data Engineer with expertise in Spark and PySpark for distributed data processing.
Strong proficiency in SQL, including experience with writing complex queries, performance tuning, and database management.
Hands-on experience with cloud platforms (AWS, Azure, or GCP) and their data processing services such as AWS EMR, Azure Databricks, Google BigQuery, etc.
In-depth understanding of ETL processes, data modelling, and data warehousing concepts.
Experience working with large datasets and optimizing data pipelines for efficiency and scalability.
Familiarity with data storage technologies like Hadoop, HDFS, and cloud-based data lakes.
Knowledge of version control systems like Git, and experience working in Agile environments.
Excellent problem-solving skills and the ability to work in a fast-paced, collaborative team environment.
Strong communication skills and the ability to explain technical concepts to non-technical stakeholders.
Preferred Qualifications:
Experience with containerization and orchestration tools like Docker, Kubernetes, or Apache Airflow.
Familiarity with machine learning concepts and integration of data pipelines with ML workflows.
Experience with real-time data streaming technologies (Kafka, Apache Flink, etc.).
Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field.
Senior Data Engineer
San Jose, CA Jobs
About Us
We're on a mission to redefine how AI interacts with the world-bringing human-like understanding, perception, and communication to the forefront of technology. Our cutting-edge research in multi-modal AI powers everything from text-to-video AI avatars to real-time interactive experiences that are reshaping industries like healthcare, education, sales, and beyond.
Backed by top investors, we're rapidly scaling and looking for exceptional talent to push the boundaries of AI-driven communication. If you're ready to own data strategy at a high-growth AI company, this is your chance to make an impact.
The Role: Data Architect, Builder, and Innovator
Data isn't just fuel for our AI-it's the foundation of everything we build. As Senior Data Engineer, you won't just clean datasets and maintain pipelines. You'll own the entire data lifecycle, from sourcing and structuring to optimizing for next-gen AI models.
We're looking for someone who thinks beyond conventional data engineering-you anticipate what's next, push boundaries, and make sure our AI has access to the best data possible.
Your Mission 🚀
Be a data visionary - You see beyond the present and anticipate the data needs of future AI models, ensuring high-quality, diverse, and structured datasets that drive innovation.
Own data end-to-end - You don't just process data-you strategically source, structure, and optimize multimodal datasets (text, video, images, and more) for maximum AI effectiveness.
Shape AI model training - Work closely with ML engineers to curate and fine-tune datasets that elevate AI performance, efficiency, and inference accuracy.
Be a data hunter - Whether it's web scraping, third-party integrations, or unconventional sources, you know how to acquire the right data and scale data procurement.
Master video data - AI-generated video presents unique challenges. You'll define classification, segmentation, and structuring techniques to optimize video datasets for AI training.
Optimize labeling & automation - Develop automated pipelines that make data cleaning, labeling, and structuring seamless while maintaining gold-standard quality.
Turn internal data into insights - Our own platform is a goldmine of information. You'll uncover, organize, and optimize internal data for strategic impact.
Move fast, but don't break data - You balance speed and precision, ensuring every pipeline, dataset, and workflow is scalable, reliable, and built to last.
What We're Looking For ⚡
You don't just maintain-you build. From zero to fully running pipelines, you make things happen. You take charge of how we leverage data for AI-driven decisions.
Extreme ownership - You don't wait for someone to tell you what data we need. You proactively identify, source, and structure data for AI breakthroughs.
Product-minded approach - You understand the bigger picture and align data strategies with company goals.
Experience with multimodal AI data - Background in LLMs, video, text, and image data is a huge plus.
Automation first - You know how to automate data cleaning, structuring, and labeling to ensure efficiency and scale.
ML-first mindset - You get that better data = better models and optimize datasets for maximal AI impact.
Technical expertise - You've got Python, SQL, and large-scale data processing tools locked down.
Speed + accuracy - You move fast but never compromise on precision.
You set the standard - We're solving problems no one has solved before. You create best practices, not just follow them.
Why Join Us?
When you join our team, you're joining a fast-moving, diverse, and collaborative environment where your work has direct impact. We offer:
Flexible work schedules & remote-friendly culture
Unlimited PTO & top-tier healthcare
Generous gear stipends
A high-energy, supportive team that loves what they do
We aren't just looking for someone to fit in-we want culture creators who bring new perspectives and push boundaries. If you're ready to take data engineering to the next level and drive the future of human-AI interaction, let's talk. 🚀
Apply now and be part of the AI revolution!
Data Engineer
Irving, TX Jobs
Immediate need for a talented Data Engineer. This is a 06+months contract opportunity with long-term potential and is located in Irving, TX, Tampa, FL, New York, NY(Hybrid). Please review the job description below and contact me ASAP if you are interested.
Job ID:25-62368
Pay Range: $45 - $47/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
Key Requirements and Technology Experience:
Key skills; Scala + spark + Java
Bigdata, Spark, Scala/Java, Hive, Impala
Strong SQL skills including analysis, optimization
Good to have: Iceberg, Ozone, Kafka, ML
Our client is a leading IT Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.
Data Engineer
Richmond, VA Jobs
Immediate need for a talented Data Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Richmond, VA (Hybrid). Please review the job description below and contact me ASAP if you are interested.
Job ID:25-56318
Pay Range: $50 - $55/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
Key Requirements and Technology Experience:
Skills-Data Engineer
Strong Python
Strong Spark
AWS.
Our client is a leading Banking Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.
Senior Data Engineer
Orlando, FL Jobs
Senior Data Engineer - Revenue Management Systems
6 Month Contract
Orlando
Direct applicants only, no C2C company or 3rd Party candidates can be considered.
Are you an experienced Senior Data Engineer with a passion for building and optimizing complex data solutions in Revenue Management Systems? Our client, is seeking a talented professional to join their dynamic team and drive data infrastructure excellence.
About the Role
As a Senior Data Engineer, you will play a pivotal role in designing, developing, and maintaining data pipelines and infrastructure that power the company's Revenue Management Systems. You'll work closely with cross-functional teams to ensure data accuracy, scalability, and performance, enabling data-driven decision-making and maximizing revenue growth.
Key Responsibilities
Design, build, and maintain robust and scalable data pipelines and architectures.
Develop and implement data models to support revenue optimization and predictive analytics.
Collaborate with data scientists, analysts, and business teams to define data requirements and deliver insights.
Optimize data processing and ETL performance to handle large-scale data sets efficiently.
Ensure data quality, integrity, and security across all systems.
Automate data workflows and implement best practices for data governance and compliance.
Skills & Experience Required
- 5+ years of experience in Data Engineering, preferably within Revenue Management Systems.
- Strong proficiency in SQL, Python and PySpark
- Experience with AWS, Snowflake and Databricks
- Deep understanding of data modeling, ETL development, and data warehousing principles.
- Proven experience working with large, complex data sets and real-time data processing.
- Strong problem-solving skills and ability to work in a fast-paced environment.
- Experience with machine learning or statistical models for revenue forecasting is a plus.
Apply today to join a forward-thinking company where your skills and experience will make a real difference.
Sr. Data Engineer
Wayne, PA Jobs
Are you an experienced Sr. Data Engineer with a desire to excel? If so, then TALENT Software Services may have the job for you! Our client is seeking an experienced Sr. Data Engineer to work at their company in Wayne, PA.
We are seeking a skilled Sr Data Engineer to join our Commercial Team. In this role, you will collaborate with stakeholders to design, build, and maintain data infrastructure that supports the commercial team's efforts, enabling seamless data flow, analysis, and reporting. You will be responsible for integrating various data sources and building dashboards for high-performance analytics. The ideal candidate will have strong technical skills in data engineering, experience working with sales and marketing data, and a passion for creating data solutions that drive business decisions and growth.
Primary Responsibilities/Accountabilities:
Data Integration & Management
Work closely with commercial teams to understand their data needs and integrate various data sources to create a unified view of revenue, order, pipeline, marketing lead, and customer data.
Develop efficient data models that support business reporting and decision-making, using tools like SQL, Python, or R.
Collaborate with data scientists and analysts to ensure data integrity, quality, and availability for advanced analytics and reporting.
Data Dictionary Development & Management
Design, develop, and maintain a comprehensive commercial data dictionary including revenue, order and pipeline data from Snowflakes that defines all data elements, ensuring clear documentation for all stakeholders.
Collaborate with business units, sales excellence and IT teams to gather detailed information on data sources, definitions, relationships, and usage.
Ensure that the data dictionary is up-to-date and accessible, promoting standardization and consistency across the organization.
Implement processes for ongoing management and updates to the data dictionary as data models and requirements evolve.
Power BI Data Model Design
Build and optimize Power BI data models that support reporting and analytics requirements, ensuring that data is well-structured for efficient querying and analysis.
Develop snowflake schema data models to support high-performance, scalable dashboards and reports in Power BI.
Work closely with business analysts and end-users to translate business needs into technical data models and visualizations in Power BI.
Create DAX measures and calculations to support complex reporting needs within Power BI dashboards.
Reporting & Visualization
Support the development of Power BI dashboards by providing clean, structured data for visualizations.
Assist the commercial team in building custom reports and dashboards by ensuring the data infrastructure supports their requirements.
Enable real-time reporting by integrating live data feeds where applicable.
Data Infrastructure & Automation
Build, maintain, and optimize scalable data pipelines to support automated data processing and real-time analytics.
Work with IT and data engineering teams to ensure data is properly collected, stored, and accessible for analysis.
Automate recurring tasks such as reporting, data extraction, and analysis to improve operational efficiency.
Experience working with large datasets and creating data models to support business intelligence and analytics initiatives.
Qualifications:
Bachelors or Masters degree in Computer Science, Data Engineering, Information Systems, or a related field.
3 years of experience in data engineering, with a strong focus on building data models and managing data dictionaries.
Proven experience with Power BI, including building complex data models, optimizing performance, and creating dashboards with DAX/PowerQuery.
Strong SQL skills for data querying and manipulation, with experience in database management and ETL processes.
Preferred:
Expertise in statistical and mathematical methodologies for data analysis.
Experience with CRM systems (e.g., Salesforce, C4C) and sales performance data.
Exceptional project management and organizational skills.
Effective communication skills, capable of conveying complex data insights to non-technical audiences.
Proven ability to foster a collaborative team environment.
Strategic thinking and proactive problem-solving abilities.
Data Governance Consultant
New York, NY Jobs
Team Profile:
The Data Sourcing Team supports Finance though delivery of Data Souring and Systems Governance initiatives. The team delivers improved data quality for key regulatory implementations deliverables include data sourcing, data cataloging, lineage, controls identification, and issues management for a wide range of sales and trading products. The team's objective is to improve data quality in Finance Data Warehouse (FDW). This will enable the Finance Shared Services team complete FD's vision of ”Source Once, Control Once, Adjust Once & Use Many.” This is completed by working closely with Finance (Treasury, Capital, External Reporting), Technology, Risk and Operations.
Job Duties:
-Data sourcing project delivery including business analysis and program management.
-Communicate and work alongside a diverse group of professionals in Finance and across the Firm including regular interaction with IT and team members across External Reporting, Capital, and Treasury.
-Partner with IT to deliver new data sourcing using Agile methodology.
-Work with clients and IT colleagues to document and prioritize business requirements.
-Identify strategic sources for new data.
-Deliver analysis and testing including reconciliations between legacy and new systems.
-Complete system dictionary, feed review, feed governance, and data control.
-Ensure upstream data is controlled via existing controls with data owners.
-Build effective presentations for senior management forums in relation to deliverables.
Requirements:
-Strong project management skills. Data sourcing and governance experience is a plus
-Ability to identify trends and linkages across systems / teams
-Understanding of financial products (e.g.: Options, Futures, etc.)
-Analytical capabilities, including ability to summarize business problems and solutions
-Strong written and verbal communication skills, and ability to adapt to your audience
-A strong sense of organization and time management skills
-Ability to understand intricate processes and identify potential opportunities for improvement
-Proficient Microsoft Office skills with an emphasis on Excel and PowerPoint
-Knowledge of Agile Project Management methodologies and Alteryx would be a plus
Data Engineer
Boston, MA Jobs
W2 Only role.
Data Engineer (Must have Databricks)
Need Mid level (3-5Yrs)
Key Skill: Strong Databricks, AWS, Apache Spark, SQL, Scala/Python, Hadoop
Skill Sets Required
Good decision-making and problem solving skills
Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering and SQL warehouse).
Solid Knowledge on medallion architecture, DLT and unity catalog within Databricks.
Experience in migrating data from on-prem Hadoop to Databricks/AWS
Understanding of core AWS services, uses, and AWS architecture best practices
Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
Solid knowledge on Airflow
Solid knowledge on CI/CD pipeline in AWS technologies
Application migration of RDBMS, java/python applications, model code, Opensearch etc.
Solid programming background on scala and/or python with Spark
Experience with Docker and Kubernetes is a plus
Sr. Data Engineer
Roanoke, TX Jobs
Special Instructions
MUST HAVE:
ETL (snaplogic or Informatica),
Relational databases (Oracle, PostgreSQL, etc.),
NoSQL databases (DynamoDB, Elastic search),
Python,
AWS,
Kafka
Description:
We are seeking a Full Stack Data Engineer to join our team in our Westlake TX location.
The Expertise and Skills You Bring
Bachelor's or Master's degree in a technology related field (e.g., Computer Engineering, Computer Science, etc.)
Proven track record as a data engineer, crafting new solutions and re-platforming legacy data products
Knowledge of how to effectively use multiple types of databases such Relational databases (Oracle, PostgreSQL, etc.), NoSQL databases (DynamoDB, Elastic search) and Graph databases (Neptune, Neo4J, etc.)
Hand on experience in data pipelines and ETL/ELT process on AWS using Python, Java, etc.
Demonstrated ability to synthesize and analyze data from multiple sources and deriving insights from it
Demonstrated experience developing, debugging and tuning complex SQL statements
Experience in Kafka Data Streaming (or other streaming/messaging services Kinesis, SNS, SQS)
Experience with DevOps or CI/CD Pipelines using Git, Maven, Jenkins, uDeploy, Stash, Ansible, etc.
Ability to validate, monitor, and solve issues during development, testing, or in production
Proven knowledge of AWS via Associate, Professional, or Specialty Certification(s) a big plus
Knowledge on RestfulAPI development and container processing is a plus
Excellent communication skills, both through written and verbal channels
Ability to work effectively in global teams distributed across geographic locations in an Agile way
Excellent facilitation, influencing and negotiation skills
Desire and ability to learn and implement new technologies
Keen ability to see complex challenges from multiple perspectives, and leaning in to solve independently or with others
Data Engineer
Phoenix, AZ Jobs
Job Title: GCP Data Engineer
Job Title: Sr Data Engineer GCP
Mission/Project:
Migration of Java Applications to GCP
Day-to-Day:
Conduct an analysis of the applications and the current environment and recommend the best approach for the migration, eg should it be a simple lift and shift or there needs to be a code refactoring etc.
Must Haves (and how they are used):
Exp with data engg, data movement, ETL, Java applications
Hands on exp with GCP (services like BigQ, Bigtables, GKE etc) or other public cloud
Exp with migration of Java Apps
Excellent communication and presentation skills
Personality - who is not afraid of sharing feedback and coming up with new ideas
Data Engineer
Boston, MA Jobs
______________________________________________ONLY W2 ________________________________________________
Data Engineer - ONLY W2
Long Term Project
Client: Direct
The Expertise and Skills You Bring
Bachelor's or Master's Degree in a technology related field (e.g. Engineering, Computer Science, etc.) required with 5+ years of experience.
Advanced SQL/PLSQL knowledge.
2+ years of Python development.
Experience with Unix scripting and scheduling tools.
Good experience in working with AWS or similar Cloud Technologies.
Strong data modeling skills doing either Dimensional or Data Vault models.
Proven data analysis skills.
Experience working with snowflake database is a plus.
Hands-on experience on SQL query optimization and tuning to improve performance is desirable.
Hands-on experience with ETL tool like Informatica is a desirable
Working experience with some or all the following: AWS, Containerization, associated build, and deployment CI/CD pipelines.
Experience with DevOps, Continuous Integration and Continuous Delivery (Jenkins, Stash, Concourse, Artifactory).
Experience in Agile methodologies (Kanban and SCRUM) is a plus.
Proven track record to handle ambiguity and work in fast paced environment.
Good interpersonal skills to work with multiple teams in the organization.
Azure and Snowflakes Data Engineer
Richardson, TX Jobs
Infosys is seeking an Azure and Snowflake Data Engineer. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will be responsible to interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.
Required Qualifications:
Candidate must be located within commuting distance of TX/NC or be willing to relocate to the area. This position may require travel in the US
Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
At least 6 years of Information Technology experience
At least 3 years of Azure experience
At least 3 years of Snowflake experience
Strong knowledge and hands-on experience in SQL, Unix shell scripting, and Python
Preferred Qualifications:
Experience and desire to work in a global delivery environment
Experience in Banking/Financial domain
Sound knowledge of software engineering design patterns and practices
Strong knowledge Data structures, Data Engineering concepts, Algorithms, Collections, Multi-threading and memory management and concurrency
Experience in large scale cloud data migrations using technologies such as Snowflake, Python, Spark, Databricks
Good understanding of Agile software development frameworks
Strong communication and Analytical skills
Good to have experience AWS Databricks
Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams
About Us
Infosys is a global leader in next-generation digital services and consulting. We enable clients in 50 countries to navigate their digital transformation.
With over three decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
To learn more about Infosys and see our ideas in action please visit us at ***************
EOE/Minority/Female/Veteran/Disabled/Sexual Orientation/Gender Identity/National Origin
Senior Data Engineer Quantexa
Data Engineer Job At Capgemini
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
YOUR PROJECT
Insights & Data practice delivers cutting-edge data centric solutions. Most of our projects are Cloud & Big Data engineering. We develop solutions to process large, also unstructured, datasets, with dedicated Cloud Data services on Snowflake, AWS, Azure or GCP.
We are responsible for full SDLC of the solution: apart from using data processing tools (e.g., ETL), we code a lot in Python, Scala or Java and use DevOps tools and best practices. The data is either exposed to downstream systems via API, outbound interfaces or visualized on reports and dashboards. Within our AI CoE we deliver Data Science and Machine Learning projects with focus on NLP, Anomaly Detection and Computer Vision.
Additionally, we are exploring the area of Quantum Computing, searching for practical growth opportunities for both us and our clients.
Currently, over 250 of our Data Architects, Engineers and Scientists work on exciting projects for over 30 clients from different sectors (Financial Services, Logistics, Automotive, Telco and others)
Come on Board!
YOUR TASKS
* Data Ingestion: Designing and implementing data ingestion pipelines to acquire and extract data from various sources such as databases, APIs, flat files, and streaming platforms
* Data Transformation: Developing Quantexa ETL processes to clean, normalize, and transform raw data into a format suitable for analysis and modeling
* Development of advanced analytics solutions for Anti-Money Laundering (AML) and Countering Terrorist Financing (CTF)
* Data processing efficiency improvement, migrations from on-prem to public cloud platforms
* Frequently used technologies: Quantexa 5, Spark 4, Scala 3, Python 3, Azure 3, SQL 3
YOUR PROFILE
* At least 3 years of experience in Big Data or Cloud projects in the areas of data analysis and data transformation
* Hands-on experience with Scala and Spark
* Practical experience with the Quantexa platform (certification is an advantage)
* Knowledge of and experience with ITIL, Agile (Scrum) and DevOps methodologies
* English C1
WHAT YOU'LL LOVE ABOUT WORKING HERE
* Practical benefits: yearly financial bonus, private medical care with Medicover with additional packages (e.g., dental, senior care, oncology) available on preferential terms, life insurance and access to NAIS benefit platform.
* Access to over 70 training tracks with certification opportunities (e.g., GenAI, Excel, Business Analysis, Project Management) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, Pluralsight, TED Talks, Coursera and Udemy Business materials and trainings.
* Cutting-Edge Technology: Position yourself at the forefront of IT innovation, working with the latest technologies and platforms. Capgemini partners with top global enterprises, including 145 Fortune 500 companies.
* Enjoy hybrid working model that fits your life - after completing onboarding, connect work from a modern office with ergonomic work from home, thanks to home office package (including laptop, monitor, and chair). Ask your recruiter about the details.
GET TO KNOW US
Capgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued.
Do you want to get to know us better? Check our Instagram - @capgeminipl or visit our Facebook profile - Capgemini Polska. You can also find us on TikTok! - @capgeminipl.
ABOUT CAPGEMINI
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 360,000 team members globally in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms.
Apply now!