Data Engineer Jobs in Richmond, CA

Business Integration Partners (BIP) is Europe's fastest growing digital consulting company and are on track to reach the Top 20 by 2025, with an expanding global footprint in the US (New York, Boston, Chicago, Tampa, Charlotte, Dallas, and Houston). Operating at the intersection of business and technology we design, develop, and deliver sustainable solutions at pace and scale creating greater value for our customers, employees, shareholders, and society. Position Overview: BIP US is seeking to grow its US consulting team and is looking for a Data Scientist with 5-7 years of experience to join our BIP Bay Area consulting team. This consultant will work at the intersection of Finance and Engineering, helping us optimize revenue, track key financial metrics, and improve decision-making with data-driven insights. This consultant must thrive in fast-paced environments, have a passion for digging into data to drive business strategy, and be able to bridge the gap between Finance and Engineering. You must have valid US work authorization and must physically reside in the Bay Area, within a 50-mile commute. We are unable to support relocation costs. Please do not apply for this position unless you meet the criteria outlined above. Key Responsibilities: Usage-Based Billing Analysis - Develop and refine billing models by product, ensuring alignment between revenue and usage data. Tracking Credits & Cost Margin Analysis - Monitor credit usage and analyze cost margins to optimize pricing strategies. Churn Modeling & Customer Retention - Build predictive models to identify risk factors for customer churn and develop strategies to improve retention. Agent Conversion Analytics - Analyze user behavior and engagement data to improve conversion rates from free to paid customers. Cycle Tracking & ARR Waterfall - Monitor customer lifecycle trends, track Annual Recurring Revenue (ARR) movements, and forecast financial outcomes. Cross-functional Collaboration - Work closely with Finance, Product, and Engineering teams to ensure data insights drive strategic business decisions. Qualifications: Bachelor's degree and 5-7 years of experience in Data Science, Analytics, or a related field. Strong expertise in data analytics, financial modeling, and business intelligence. Experience with programs & tools such as Hashboard, Amplitude, Stripe, Google, Apple, DBT Labs, Bitquery, and Python. Exceptional communication and storytelling skills - ability to present complex data in a clear and compelling way to executives. Strong problem-solving skills with a curious and proactive mindset -analyzing data, asking the right questions and finding solutions accordingly. Experience working cross-functionally with Finance (CFO/FP&A) and Engineering teams. Ability to thrive in ambiguity and adapt quickly in a high-growth startup environment. **The base salary range for this role is $150,000-$175,000** Benefits: Choice of medical, dental, vision insurance. Voluntary benefits. Short- and long-term disability. HSA and FSAs. Matching 401k. Discretionary performance bonus. Employee referral bonus. Employee assistance program. 9 public holidays. 22 days PTO. PTO buy and sell program. Volunteer days. Paid parental leave. Remote/hybrid work environment support. For more information about BIP US, visit ********************************* Equal Employment Opportunity: It is BIP US Consulting policy to provide equal employment opportunities to all individuals based on job-related qualifications and ability to perform a job, without regard to age, gender, gender identity, sexual orientation, race, color, religion, creed, national origin, disability, genetic information, veteran status, citizenship, or marital status, and to maintain a non-discriminatory environment free from intimidation, harassment or bias based upon these grounds. BIP US provides a reasonable range of compensation for our roles. Actual compensation is influenced by a wide array of factors including but not limited to skill set, education, level of experience, and knowledge.

Brahma Consulting Group is a Recruitment firm powered by a mission to deliver personalized, industry-focused recruitment solutions. We are currently assisting our client, a global leader in enterprise-grade data analytics and AI solutions, in their search for a Data Scientist in Mountain View, CA. This is a full-time permanent position. Responsibilities Analyze raw data: assessing quality, cleansing, structuring for downstream processing Design accurate and scalable prediction algorithms Collaborate with engineering team to bring analytical prototypes to production Generate actionable insights for business improvements Qualifications Bachelor's degree or equivalent experience in quantitative field (Statistics, Mathematics, Computer Science, Engineering, etc.) 3+ Years of Banking / Payments analytics experience preferably in a consulting set-up Strong experience of developing and deploying Predictive/ML solutions Proficiency in SQL, Tableau, Python Strong experience in Big Data Technologies like Hadoop, Spark or similar platforms Excellent communication skills and strong stakeholder management experience Strong problem-solving skills Proficiency in Mandarin is a plus

Kindred is a members-only home swapping network that unlocks the ability to live a travel-rich lifestyle through the power of community. By exchanging primary residences with trusted peers, renters and owners alike can match with Kindred spirits and explore new destinations without breaking the bank. We are on a mission to build a sharing economy that lives up to the name, and we've raised significant capital from some of the best investors in Silicon Valley, including Index Ventures, Andreessen Horowitz, New Enterprise Associates, Bessemer Venture Partners, Caffeinated Capital, Elad Gil, and the founders of Opendoor, Figma, ClassPass, Clubhouse, Divvy, Gem, and Homebound. The co-founders are proven leaders from the early team at proptech company Opendoor ($15B+ exit) and have each separately built and scaled products that today do $1B+ annual revenue combined. We're looking for the world's top builders, executors, and believers to join us on this ride. You can learn more about us in Forbes and TechCrunch. The Role: This role offers an exceptional opportunity to shape the future of Kindred by directly influencing our core business strategy-from growth to operations. You will collaborate closely with a top-tier team of executives and engineers to tackle some of Kindred's most complex challenges, including optimizing the credit economy, balancing inventory, and refining dynamic pricing. We're looking for someone who thrives both as a hands-on individual contributor and leader, capable of diving deep into complex problems while building a world-class data science team. This role requires a rare combination of technical acumen, strategic foresight, and leadership excellence, with the potential to create a lasting, transformative impact on Kindred's success. Some of the challenges you will tackle include: Dispatch Priority: In a system without cash exchanges, Kindred requires an innovative “match” system to determine member booking priority based on factors such as home demand, similarity, and user reputation. Think of it similar to dispatch models for ride-sharing apps - ensuring the best possible matches while optimizing the member experience. Inventory Balance: Kindred's unique model, where every guest is also a host, means supply and demand are intrinsically linked - we cannot add a unit of supply without also adding a unit of demand. You will work closely with the marketing team to monitor and balance inventory, deploying various product and credit strategies to optimize the flywheel. Dynamic Pricing: You'll leverage market data to define and implement pricing strategies, ensuring Kindred delivers undeniable value to our members while meeting profitability targets. Intelligent Automation: You will lead the development and deployment of AI-driven solutions, such as an AI assisted concierge, to streamline customer support operations and enhance margins-while maintaining an exceptional, best-in-class member experience. You may be a right fit for this role if you: Have at least 10+ years of experience in data science, or a related field, with a strong background in leading complex, cross-functional projects and driving data-driven decision-making. MS / PhD in a quantitative discipline (e.g., Economics, Statistics, Machine learning) Demonstrate strategic foresight and are able to think beyond the immediate challenge. You can balance both short-term tactical priorities with long-term goals and strategically navigate competing demands. Have experience building and leading high-performing teams. You are capable of mentoring and growing a world-class data science team while working collaboratively with executives and other teams to drive company-wide impact. Are results-oriented and have a proven track record of delivering innovative, data-driven solutions that impact business performance, such as dynamic pricing models, inventory optimization, or customer segmentation. Have excellent communication skills and can clearly articulate complex data science concepts to non-technical stakeholders. You can effectively present insights, recommendations, and technical roadmaps to executives and other teams. Are customer-centric, with a deep understanding of how data science can enhance the user experience. You have a keen focus on delivering value to members while improving operational efficiency. Thrive in an entrepreneurial environment and are excited about the opportunity to build and scale solutions in fast-paced environment. Our Benefits: At Kindred, we know that good things happen when we look out for one another. We offer our employees the following benefits: Our opening spans more than one career level. The base salary offered depends on many factors, such as work experience, transferable skills, business needs and impact, and market demands. A vibrant, inclusive, and highly skilled team that ferociously protects team chemistry A culture of championship (vs. just mentorship), feedback, and continual development Competitive cash compensation and equity Comprehensive health benefits Flexible vacation policy Unlimited credits to stay at Kindred homes during your time as an employee $4,000 annual travel stipend to use toward travel costs to stay at a Kindred home Remote-flexible work environment. We encourage team members to travel and adventure, including working from Kindred HQ in San Francisco! Regular offsites to co-locate with the team

Own the tooling, frameworks, data pipelines, integrations, databases, schemas and data integrity of this environment. You are a critical member of the team in supplying the data that underpins key operations, uncover hidden issues, and powers insight through reports, analytics and dashboards owned and managed by our team. Our operations team will depend on you to find, source, prepare and supply the right data. Our marketing and sales team will depend on you to serve the right data quickly and reliably to our customers so they can make decisions. Our research team relies on you to deliver reports to inform them of their decisions. Responsibilities: Enable our research team to make data-driven decisions based on timely, consistent, complete, and correct data, reports and analytics Work closely with engineering team members to support our existing ETL processes and solving our analytics needs Be the subject matter expert in all things data pipelines, data lakes and warehouse, tooling & frameworks, integration and sourcing of data Collaborate with cross-functional teams to gather and analyze business requirements. Develop and optimize ETL processes to ensure data accuracy and integrity. Implement data governance and security measures to protect sensitive information. Provide technical leadership and mentorship to other BI engineers. Possess the vision to guide us to the next stage of our data journey. Be detail-oriented, with a healthy level of skepticism that drives you to investigate even minor data discrepancies. Quickly learn new languages, tools, and frameworks, and be willing to explore uncharted territories to achieve your objectives. Maintain curiosity about innovative approaches and strive to push the boundaries of existing methodologies. Excel in a collaborative and team-oriented environment. Required Skills: B.S. in Computer Science, or related data field 6+ years of experience in Data Engineering, ETL, Data Science or related role Expert knowledge of Azure, Data Factories, SQL, Fabric Proficiency in BI tools such as Tableau, Power BI, or Looker. Proficiency in ETL tools and processes. Knowledge of Snowflake Excellent problem-solving and analytical skills. Strong communication and collaboration abilities. Experience in the financial services or investment industry Compensation: $170-$200k, DOE

Seeking a Senior Data Engineer for the following role - Basic Qualifications 5+ years of relevant data engineering experience with specific experience in Airflow, Snowflake and Databricks. 1+ years of experience in Python. Strong understanding of data modeling principles including Dimensional modeling, data normalization principles. Good understanding of SQL engines and able to conduct advanced performance tuning. Ability to think strategically, analyze and interpret market and consumer information. Strong communication skills - written and verbal presentations. Excellent conceptual and analytical reasoning competencies. Comfortable working in a fast-paced and highly collaborative environment. Familiarity with Agile Scrum principles and ceremonies. Preferred Qualifications 2+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments, required. 2+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems (Snowflake or Redshift), required. 1+ years of experience with data orchestration/ETL tools (Airflow, Nifi), preferred. Experience with Snowflake, Databricks/EMR/Spark, and/or Airflow. Education BS in Computer Science, Information Systems The estimated pay range for this position is USD $85.00/hr - USD $91.50/hr. Exact compensation and offers of employment are dependent on job-related knowledge, skills, experience, licenses or certifications, and location. We also offer comprehensive benefits. The Talent Acquisition Partner can share more details about compensation or benefits for the role during the interview process.

Job Title: Senior Data Scientist (MarTech) Duration: 12+ months Contract (Potential to extend) Pay: $100/$110/Hr on W2 (depends upon experience) MarTech Data Science Measurement empowers Client to optimize marketing ROI by generating data-driven recommendations. We lead the way in defining and advancing best practices for measuring and optimizing marketing impact. We collaborate with Marketing, Finance, and Engineering to provide actionable recommendations and tools based on effective, timely, and granular measurements. Our team's tenets are: Actionable: Deliver insights that drive confident business decisions. Impactful: Prioritize projects based on their expected value to Client. Balanced: Adapt methods to business questions and data realities, acknowledging limitations. Rigorous: Maintain methodological integrity and quantify the sensitivity of findings. Innovative: Invest in advancing measurement science and developing new methods. Influential: Share learnings across Client and the broader data science community. The difference you will make: We are seeking an experienced Data Scientist with deep expertise and experience building data pipelines and automating measurement systems. The ideal candidate will have experience working with Apache Airflow and Spark, as well as a comprehensive understanding of SQL. They are expected to be fluent in multiple statistical programming languages, particularly R and Python. They should also be familiar with causal inference methodologies, including experimental and observational approaches. The ideal candidate will be capable of hands-on data work to produce insights and recommendations for stakeholders, driving impactful decisions in our marketing efforts. A typical day: Data Pipelines: Build novel data pipelines that accelerate the work of our data science team, including automating data validation, unit testing, and other common processes. Productionalizing Prototypes: Refine prototypes built by other scientists and prepare them to be productionalized within Client's systems. Causal Inference: Apply and develop causal inference methods, especially around MMM, to estimate the effectiveness of Client's marketing initiatives. Data Analysis: Conduct data pulls, analyze trends, and create new features to support measurement efforts. Collaboration: Work effectively with cross-functional teams, providing insights that optimize marketing strategies. Your expertise: PhD in Economics, Statistics, Marketing, or a related field, or a Masters Degree in a similar field with 2+ years of experience. Deep knowledge of data management tools, systems, and processes, including Apache Airflow and Spark. Proficiency in statistical programming (Python and R) and database usage (SQL). Experience with media mix modeling (MMM). Ability to communicate complex concepts clearly to stakeholders at varying technical levels. Proven track record of solving business problems through data science methods. Preferred expertise: Passion for marketing and consumer science, with a desire to stay informed about the latest advances in the field. Familiarity with Bayesian modeling and its applications in marketing. Experience with causal ML modeling. Experience in developing end-to-end models for data-driven decision-making.

$60- $72/hr. ***No C2C's Need Apply*** Our client, a large Electric Vehicle Manufacture is seeking an ADAS Sensor Data Engineer for a 9-month contract or work through 12/31/2025. ***No C2C's Need Apply*** 100% onsite in Newark, CA We are seeking a skilled ADAS Sensor Data Engineer to join our innovative automotive technology team. The ideal candidate will have a strong background in working with various sensor data, including camera, LiDAR, and radar systems. You will be responsible for managing and synchronizing sensor data, ensuring its accuracy and usability for advanced driver-assistance systems (ADAS). Proficiency in C++ and Python, along with a solid understanding of Linux operating systems, is essential. Experience in software development, particularly in the context of ADAS features, is required. Automotive industry experience is a strong plus. Key Responsibilities: · Collect, process, and analyze sensor data from camera, LiDAR, and radar systems. · Synchronize and calibrate sensor data to ensure alignment and accuracy across different modalities. · Develop and maintain software tools and algorithms for sensor data processing using C++ and Python. · Collaborate with cross-functional teams to integrate sensor data into ADAS systems and features. · Work with large datasets, ensuring efficient data handling, storage, and retrieval. · Debug and troubleshoot software and hardware issues related to sensor data acquisition and processing. · Optimize sensor data pipelines for performance and reliability on Linux-based systems. · Participate in the development and implementation of ADAS features, ensuring they meet safety and performance standards. Required Qualifications: · Bachelor's or Master's degree in Computer Science, Electrical Engineering, Robotics, or a related field. · 5 years proficiency in C++ and Python programming languages. · Strong understanding of camera, LiDAR, and radar sensor technologies and data formats. · Experience in synchronizing multi-modal sensor data. · Solid understanding of Linux operating systems and development environments. · Familiarity with ADAS features and their implementation in software. · Strong problem-solving skills and attention to detail. · Excellent communication and teamwork abilities. Preferred Qualifications: · Experience in the automotive industry, particularly in the development of ADAS or autonomous driving systems. · Knowledge of sensor fusion algorithms and techniques. · Experience with real-time data processing and embedded systems. · Familiarity with automotive safety standards and regulations. Pay for this position is based on market location and may vary depending on job-related knowledge, skills, and experience. Applicants should apply via The Mice Groups Inc. website (******************* or through this careers site posting. We are an equal-opportunity employer and value diversity at The Mice Groups Inc. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. Pursuant to the Los Angeles Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. The Mice Groups Inc. values your privacy. Please consult our Candidate Privacy Notice, for information about how we collect, use, and disclose personal information of our candidates. Privacy Policy One of the basic principles The Mice Groups follows in designing and operating this website is that we ask for only the information we need to provide the service you've requested. The Mice Groups does not currently collect personal identifying information via its website except (i) to the extent that you provide this information in an online job application and (ii) to the extent that your web browser provides personal identifying information. The Mice Groups will use your personally identifying information solely for the purpose for which you submitted the information. The Mice Groups may, however, aggregate certain elements of your personal identifying information with the information of other users of our website to analyze the usefulness and popularity of various web pages on its website. The Mice Groups reserves the right to change this policy at any time by posting a new privacy policy at this location. Questions regarding this statement should be directed to *******************

About Us We're on a mission to redefine how AI interacts with the world-bringing human-like understanding, perception, and communication to the forefront of technology. Our cutting-edge research in multi-modal AI powers everything from text-to-video AI avatars to real-time interactive experiences that are reshaping industries like healthcare, education, sales, and beyond. Backed by top investors, we're rapidly scaling and looking for exceptional talent to push the boundaries of AI-driven communication. If you're ready to own data strategy at a high-growth AI company, this is your chance to make an impact. The Role: Data Architect, Builder, and Innovator Data isn't just fuel for our AI-it's the foundation of everything we build. As Senior Data Engineer, you won't just clean datasets and maintain pipelines. You'll own the entire data lifecycle, from sourcing and structuring to optimizing for next-gen AI models. We're looking for someone who thinks beyond conventional data engineering-you anticipate what's next, push boundaries, and make sure our AI has access to the best data possible. Your Mission 🚀 Be a data visionary - You see beyond the present and anticipate the data needs of future AI models, ensuring high-quality, diverse, and structured datasets that drive innovation. Own data end-to-end - You don't just process data-you strategically source, structure, and optimize multimodal datasets (text, video, images, and more) for maximum AI effectiveness. Shape AI model training - Work closely with ML engineers to curate and fine-tune datasets that elevate AI performance, efficiency, and inference accuracy. Be a data hunter - Whether it's web scraping, third-party integrations, or unconventional sources, you know how to acquire the right data and scale data procurement. Master video data - AI-generated video presents unique challenges. You'll define classification, segmentation, and structuring techniques to optimize video datasets for AI training. Optimize labeling & automation - Develop automated pipelines that make data cleaning, labeling, and structuring seamless while maintaining gold-standard quality. Turn internal data into insights - Our own platform is a goldmine of information. You'll uncover, organize, and optimize internal data for strategic impact. Move fast, but don't break data - You balance speed and precision, ensuring every pipeline, dataset, and workflow is scalable, reliable, and built to last. What We're Looking For ⚡ You don't just maintain-you build. From zero to fully running pipelines, you make things happen. You take charge of how we leverage data for AI-driven decisions. Extreme ownership - You don't wait for someone to tell you what data we need. You proactively identify, source, and structure data for AI breakthroughs. Product-minded approach - You understand the bigger picture and align data strategies with company goals. Experience with multimodal AI data - Background in LLMs, video, text, and image data is a huge plus. Automation first - You know how to automate data cleaning, structuring, and labeling to ensure efficiency and scale. ML-first mindset - You get that better data = better models and optimize datasets for maximal AI impact. Technical expertise - You've got Python, SQL, and large-scale data processing tools locked down. Speed + accuracy - You move fast but never compromise on precision. You set the standard - We're solving problems no one has solved before. You create best practices, not just follow them. Why Join Us? When you join our team, you're joining a fast-moving, diverse, and collaborative environment where your work has direct impact. We offer: Flexible work schedules & remote-friendly culture Unlimited PTO & top-tier healthcare Generous gear stipends A high-energy, supportive team that loves what they do We aren't just looking for someone to fit in-we want culture creators who bring new perspectives and push boundaries. If you're ready to take data engineering to the next level and drive the future of human-AI interaction, let's talk. 🚀 Apply now and be part of the AI revolution!

$165,000 - $185,000 BASE SALARY + EQUITY REMOTE OR HYBRID (3 DAYS ONSITE IF LOCAL) A fast-growing healthtech startup developing solutions to help healthcare organizations safely implement generative AI. Their platform ensures compliance, enhances model reliability, and provides ongoing monitoring to support responsible AI adoption. THE ROLE As a Data Engineer, you will design and optimize scalable ETL pipelines, standardize data processing workflows, and integrate healthcare data across various platforms. You'll play a key role in automating data ingestion, enhancing system reliability, and ensuring high-quality datasets for AI applications. This position requires problem-solving ability, adaptability, and a strong interest in the intersection of healthcare and AI. ROLE RESPONSIBILITIES Develop and maintain ETL pipelines that extract data from FHIR endpoints. Build and enhance data ingestion processes to streamline healthcare system integration. Automate data workflows for seamless interaction with Epic and other EHR platforms. Establish repeatable data transformation patterns to ensure consistency across systems. Deploy Infrastructure-as-Code (IaC) solutions for efficient scaling. Work closely with AI/ML teams to provide clean, structured data for model development. SKILLS & EXPERIENCE 4+ years of experience working with healthcare datasets. Strong programming skills in Python. Hands-on experience with FHIR & HL7v2 data standards. Cloud expertise in Azure (preferred), GCP, or AWS. Experience working with Snowflake & Databricks is a plus. Proven ability to scale ETL pipelines in live production environments. Familiarity with Infrastructure-as-Code (IaC) and CI/CD pipelines. Exposure to AI/ML data engineering is a plus, particularly in model training workflows. BENEFITS $165,000 - $185,000 base salary + equity. Flexible remote or hybrid work model. Opportunity to shape the future of AI governance in healthcare. If you're a data engineer passionate about AI in healthcare, we'd love to connect!

***Hybrid Data Engineer consulting opportunity in San Francisco, CA**** Focus on SQL Knowledge and workflow management (airflow tool) and Machine Learning Knowledge: Specifically Feature. Understanding data inputs into the model and feature analysis. Feature Engineering. Training data set composition. Experience with Pyspark to perform data transformations, feature engineering, data analysis, and ML training data generation. This role supports the feature generation, data workflows, and maintenance of the RealTIME personalization models for the Campaigns fleet. ***Streaming industry experience is a huge plus!*** EXTERNAL JOB DESCRIPTION: Department Overview: Applied Machine Learning Engineers, Data Engineers, and Data Scientists on the Disney Streaming Machine Learning and Innovation team develop and maintain recommendation and personalization algorithms for Streaming's suite of streaming video apps. As a member of this team you will collaborate across Engineering, Product, and Data teams to apply machine learning methods to meet strategic product personalization goals, explore innovative, cutting edge techniques that can be applied to recommendations, and constantly seek ways to optimize operational processes. Our team is… • A group of engineers and data scientists with diverse expertise delivering solutions together. • Collaborative and dynamic. • Embracing agile practices. • Using continuous integration/automated testing. • Led by startup veterans. Basic Qualifications Required Qualifications: ● 2+ years of data engineering experience ● Deep knowledge of the Python data ecosystem ● Great coding and problem-solving skills ● Experience in building large datasets and scalable services ● Experience deploying and running services in AWS and in engineering big-data solutions using technologies like Databricks, EMR, S3, Spark, and Docker ● Experience with Pyspark to perform data transformations, feature engineering, data analysis, and ML training data generation ● Excellent communication and people engagement skills Preferred Qualifications ● Experience building streaming pipelines using Kafka, Spark, or Flink ● ML algorithmic and systems knowledge/experience Responsibilities: ● Partner with technical and non-technical colleagues to understand ML algorithm feature, data, and workflow requirements. ● Implement necessary feature analysis, new features, training datasets and related workflows and monitoring metrics and services ● Work with Engineering teams to collect required data from internal and external systems ● Develop and maintain ETL routines using orchestration tools such as Airflow ● Collaborate with machine learning practitioners to design and build model and data forward solutions ● Deploy scalable streaming and batch data pipelines to support petabyte scale datasets ● Enforce common data design patterns to increase code maintainability ● Create ETL architecture designs and conduct reviews ● Perform ad hoc data analysis and maintenance as necessary ● Partner with team leads to identify, design, and implement internal process improvements ● Drive and maintain a culture of quality, innovation, and experimentation ● Work in an Agile environment that focuses on collaboration and teamwork Required Education Bachelor's degree or relevant years of work experience

Hi, Job Title: Senior Data Engineer Duration: Contract to Hire Role Interview Process: Onsite Payrate: 75 to 80/hr. on C2C Responsibilities: Key Responsibilities: Design, develop, and maintain data pipelines using Spark, PySpark, and other big data technologies to process large datasets. Build and optimize complex SQL queries for data extraction, transformation, and loading (ETL) in both batch and real-time workflows. Work with cloud platforms such as AWS, Azure, or GCP to deploy and manage data infrastructure. Collaborate with cross-functional teams to gather data requirements and deliver data solutions that meet business needs. Ensure data quality, integrity, and consistency across different stages of data processing. Optimize and troubleshoot performance of Spark and SQL-based applications. Develop and implement data models and data architectures to support analytics and business intelligence initiatives. Create and maintain automated data workflows and ensure they are scalable and maintainable. Document data processes, architectures, and pipelines to ensure knowledge sharing across teams. Required Skills & Qualifications: Proven experience as a Data Engineer with expertise in Spark and PySpark for distributed data processing. Strong proficiency in SQL, including experience with writing complex queries, performance tuning, and database management. Hands-on experience with cloud platforms (AWS, Azure, or GCP) and their data processing services such as AWS EMR, Azure Databricks, Google BigQuery, etc. In-depth understanding of ETL processes, data modelling, and data warehousing concepts. Experience working with large datasets and optimizing data pipelines for efficiency and scalability. Familiarity with data storage technologies like Hadoop, HDFS, and cloud-based data lakes. Knowledge of version control systems like Git, and experience working in Agile environments. Excellent problem-solving skills and the ability to work in a fast-paced, collaborative team environment. Strong communication skills and the ability to explain technical concepts to non-technical stakeholders. Preferred Qualifications: Experience with containerization and orchestration tools like Docker, Kubernetes, or Apache Airflow. Familiarity with machine learning concepts and integration of data pipelines with ML workflows. Experience with real-time data streaming technologies (Kafka, Apache Flink, etc.). Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field.

Calling All Data Engineers! Join a groundbreaking fintech revolution! We're seeking a BI/Data Engineer to be part of a Global Engineering Team building the future of blockchain payments. Our client has developed a cutting-edge blockchain payment platform, reshaping traditional payment systems and driving the mobile fintech revolution. Are you the type of engineer who thinks, "If I could rebuild this entire system, here's how I'd do it right"? If so, this role is for you. What You'll Do: ✅ Build and operate an Analytics Platform using AWS Native services to process streamed data across a blockchain-based payment network. ✅ Organize incoming data into structured formats for querying, reporting, and system feedback. ✅ Collaborate with product teams to implement fraud detection algorithms that enhance system security. ✅ Provide analytics for blockchain payment transaction performance management. ✅ Transform unstructured data into structured formats, optimizing data streams at their source. ✅ Design dashboards and query interfaces for operational data. ✅ Optimize data transmission by filtering out unnecessary sources. What You Bring: ✔ 2-3 years of experience with Elastic, Logstash, Kibana. ✔ Hands-on experience working with unstructured and semi-structured data. ✔ Background in fraud detection, risk analysis, and payments. ✔ Startup experience - you thrive in a fast-paced, high-growth environment. Why Join? 🚀 Be an early engineer in a small company with a big vision. 📈 Opportunities to grow a team and shape industry-leading systems. 🏡 Hybrid workspace in Silicon Valley with a competitive benefits package. 🔥 Work with driven innovators who love the startup grind! Sound like you? Reach out to **************************

⚡ tl;dr Help us get more promising new drugs to market, while helping patients access life changing medicine. Work directly with one of our cofounders to: solve crucial problems across the marketplace, develop our data infrastructure, and build out a broader data team. Join a rapidly growing company (we've ~10x'd in the past 3 quarters) while we're still just a tight-knit team of ~27. Own a number of high-impact data science initiatives across the marketplace: how might we systematize supply-demand balancing; which patients should clinics call first; etc. Work with a product team where everyone writes their own queries, and as a result where Data's role is to provide them leverage (via better infra, models, etc etc). 🧬 Let's accelerate medical innovation At Power, we're making clinical trials easy to navigate for all patients. Today, patients look to promising medical research when standard treatments have failed them. Unfortunately, there is no single source of truth that patients can understand and trust. The status quo is a government run website which is written in complex medical jargon that is impossible for most people to navigate. At the same time, clinical trials are the bottleneck on medical innovation-new medicine takes almost 10 years to test and over 86% of all clinical trials are delayed because they can't find enough patients. This is one of the biggest problems facing the life science industry. Power is the easiest way for patients to access promising new studies. Thus helping more patients find treatments and speeding up the progress of medical research as we go. 🏹 The role We're looking for our first data hire at Power. Up until now, we've operated without a data team by ensuring the product org is able to write their own queries. While this worked well as an early stage company, as we continue to scale we're professionalizing the data function in order to ensure we're learning as much as we can, as fast as we can. Plus, many of the most-impactful product surface areas today are ones where a deeper data science lens would help. To this end, the most important piece of this role is working closely with Power's cofounders to ensure our product teams have a complete grasp of key insights: both by directly contributing to our most-important data-problems, and by building systems that better enable other users to self-serve. From there this role could lean one of few ways: You could scale into a Head of Data role and build out a team here. You could lean further into Data Engineering and build a deep expertise here. You could shift your focus further towards product, and eventually be a key contributor within the product org. 🤔 Some of the problems we'll be working on We don't believe in strict job requirements, but if these problems sound fun and familiar, you're probably well suited for this gig: Building our ranking system that recommends which patient a clinic should call next. Elevating our current systems for balancing supply and demand across the marketplace. Conducting a ‘magic moment' analysis to determine what makes sites on our platform successful Challenging our thinking re: the best possible outputs & leading indicators for us to be monitoring across each of our product streams Codifying user segments in our analysis, such that we can quickly understand which user-groups are best served by new features. Analyzing gaps in ‘self-reported' and ‘EMR-reported' patient attributes, to better understand which questions our patients can reliably answer. Building intuitive views for our demand-side and patient-side user segments, so that our team can analyze feature-product fit across segments. 🎯 About you You've spent a considerable part of your professional life analyzing data. You're probably intimately familiar with both SQL and (Python or R). You're energized by the process of ‘finding out': you take real pleasure in uncovering novel insights & shaping your colleagues' understanding of the world. You're exceptional at communicating data: you're able to imagine intuitive reports & to distill down key findings in a way that non-technical team members can understand. You've demonstrated the ability to contribute strategically, by translating discoveries into recommendations for the broader business. You're wholly comfortable both leading your own analysis and maintaining your own tooling + data stack. This autonomy is something you're excited about, not something that's daunting. You can drive projects independently or work in a highly collaborative, x-functional manner. You naturally balance speed, craft, and business goals. 🌟Nice to haves You have a personal connection to the space: much of our team has close family or friends who've interacted with clinical research from the patient perspective. You have a deep familiarity with marketplace businesses, clinical research, or health tech more broadly. You've led data teams of a larger scale, and will be able to help us see around corners. You have some other ‘spike' or unique strength that would round us out! We're always looking for complementary skills & experiences. You like to dive into the lit in your personal life - whether it be for sleep, nutrition, supplements, or something else entirely. 🔎 The product Power is the most patient-friendly marketplace resource for clinical trials. Comprehensive: we make it easy to search across every trial in North America so patients never feel like they have blind spots Simple: we apply a healthy amount of data engineering and empathy to the reams of unstructured medical data on clinical trials to simplify things for patients that are trying to evaluate potential trials Connected: we help patients proactively reach out to the researchers directly and researchers love connecting with motivated patients ✉️ If this sounds like your kind of adventure We'd love to hear from you. Email ******************

Job Title: Data Analytics Leader Contract Until 03/06/2026 with possible extension Education & Experience: Bachelor's degree in Data Dcience, Statistics, Computer Science, Life Sciences, Public Health, or a related field. Master's degree preferred. 2+ years' experience in Biotech/Pharmaceutical industry with knowledge of the pharmaceutical/biotech clinical development process 3+ years' experience in Analytics or Statistics (4+ years of experience with a master's degree) 2+ years of experience in RBQM / RBM processes, including awareness of industry strategy and direction, knowledge and understanding of ICH E8 and ICH E6 requirements Strong proven experience using data driven methods to analyze and solve business situations, strong critical thinking and analytical skills and aptitude for data analytics including mathematical and statistical concepts Technical Skills: Proficient in Data Analysis tools (e.g., R, Python, JMP) for manipulating, analyzing large datasets, creating visualizations, and applying statistical methods (hypothesis testing, regression analysis, data modeling) to analyze clinical trial data Proficient in Data Visualization tools (e.g., Tableau, Spotfire) Experience and understanding of Clinical Trial Data from various sources (e.g. Veeva, RAVE, IRT, SDTM, clinical devices, etc)

We are assisting one of our start up clients build out their Data Science team as they disrupt B2B marketing. This person will apply advanced analytics and machine learning to improve their marketing platform as well as collaborate with senior leadership. Key Responsibilities: Performance & Growth Marketing Analytics: Apply expertise in performance marketing to detect ad fatigue, optimize match rates, and build audience models that drive campaign success. Advanced Analytics & Machine Learning: Collaborate with the Integrations team to apply advanced data analytics and ML techniques to optimize how data flows within Primer. User-Facing Features: Use insights to help build an AI copilot that drives better decision-making for our users, by developing targeting algorithms for improved customer outcomes. Collaborate Across Teams: Partner with internal data architects, product teams, and engineers to ensure data insights are impactful and lead to meaningful product outcomes. Must-Have Qualifications: Growth/Performance Marketing Experience: Expertise in growth/performance marketing analytics, especially in areas such as ad fatigue detection, match rate optimization, and audience modeling. Versatile Data Scientist: Strong capability to handle various aspects of data science-basic analysis and visualization, statistical analysis, and model development. Proven ML Experience: Demonstrated experience in productionizing machine learning algorithms into user-facing features and products. Product-Minded: A deep understanding of product development with a user-centric mindset, collaborating with product teams to prioritize the user experience.

Lead Data Engineer, Data ReliabilityJob ID 10103077 Location Santa Monica, California, United States / Bristol, Connecticut, United States / San Francisco, California, United States / New York, New York, United States / Seattle, Washington, United States Business Disney Entertainment & ESPN Technology Date posted Jan. 21, 2025Job Summary: On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world. The Data Reliability Engineering team for Disney's Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment's big data platform, which processes hundreds of terabytes of data and billions of events daily. The Lead Data Engineer will help us in the ongoing mission of delivering outstanding services to our users allowing Disney Entertainment to be more data-driven. You will work closely with our partner teams to monitor and drive improvements for reliability and observability of their critical data pipelines and deliverables. This is a high-impact role where your work informs decisions affecting millions of consumers, with a direct tie to The Walt Disney Company's revenue. We seek people who are passionate about solving the toughest challenges and working at scale, using, supporting, and building distributed systems in a fast-paced collaborative team environment. Assist in designing and developing a platform to support incident observability and automation. Lead project work efforts internally and externally setting project deliverables, review design documents, perform code reviews and help mentor junior members of the team. Collaborate with engineering teams to improve, maintain, performance tune, and respond to incidents on our big data pipeline infrastructure. Own building out key components for observability and intelligent monitoring of data pipelines and infrastructure. Build solutions to continually improve our software release and change management process. Minimum Qualifications: 7+ years of experience working on mission critical data pipelines and ETL systems. 7+ years of hands-on experience with big data technology, systems and tools such as AWS, Hadoop, Hive, and Snowflake. Expertise with common Data Engineering languages such as Python, Scala, Java, SQL. Experience with workflow orchestration tools such as Airflow. Deep understanding of end-to-end pipeline design and implementation. Bachelor's degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study. #DISNEYTECH #J-18808-Ljbffr

On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world. A few reasons why we think you'd love working for Disney Entertainment & ESPN Technology Building the future of Disney's media business: DE&E Technologists are designing and building the infrastructure that will power Disney's media, advertising, and distribution businesses for years to come. Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day - from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more. Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news. The Data Reliability Engineering team for Disney's Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment's big data platform, which processes hundreds of terabytes of data and billions of events daily. About The Role The Lead Data Engineer will help us in the ongoing mission of delivering outstanding services to our users allowing Disney Entertainment to be more data-driven. You will work closely with our partner teams to monitor and drive improvements for reliability and observability of their critical data pipelines and deliverables. This is a high-impact role where your work informs decisions affecting millions of consumers, with a direct tie to The Walt Disney Company's revenue. You will be making an outsized impact in an organization that values data as its top priority. We are a tight and driven team with big goals, so we seek people who are passionate about solving the toughest challenges and working at scale, using, supporting, and building distributed systems in a fast-paced collaborative team environment. We also support a healthy work-life-balance. Responsibilities Assist in designing and developing a platform to support incident observability and automation. This team will be required to build high quality data models and products that monitor and reports on data pipeline health and data quality. Lead project work efforts internally and externally setting project deliverables, review design documents, perform code reviews and help mentor junior members of the team. Collaborate with engineering teams to improve, maintain, performance tune, and respond to incidents on our big data pipeline infrastructure. Own building out key components for observability and intelligent monitoring of data pipelines and infrastructure to achieve early and automated anomaly detection and alerting. Present your research and insights to all levels of the company, clearly and concisely. Build solutions to continually improve our software release and change management process using industry best practices to help DSS maintain legal compliance. Basic Qualifications 7+ years of experience working on mission critical data pipelines and ETL systems. 7+ years of hands-on experience with big data technology, systems and tools such as AWS, Hadoop, Hive, and Snowflake Detailed problem-solving approach, coupled with a strong sense of ownership and drive A passionate bias to action and passion for delivering high-quality data solutions Expertise with common Data Engineering languages such as Python, Scala, Java, SQL and a proven ability to learn new programming languages Experience with workflow orchestration tools such as Airflow Deep understanding of end-to-end pipeline design and implementation. Attention to detail and quality with excellent problem solving and interpersonal skills Preferred Qualifications Advanced degrees are a plus. Strong data visualizations skills to convey information and results clearly Ability to work independently and drive your own projects. Exceptional interpersonal and communication skills. Impactful presentation skills in front of a large and diverse audience. Experience with DevOps tools such as Docker, Kubernetes, Jenkins, etc. Innate curiosity about consumer behavior and technology Experience with event messaging frameworks like Apache Kafka A fan of movies and television is a strong plus. Required Education Bachelor's degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience Additional Information #DISNEYTECH The hiring range for this position in Santa Monica, California is $152,200 to $204,100 per year, in Bristol, Connecticut is $152,200 to $204,100 per year, in Seattle, Washington is $159,500 to $213,900 per year. in New York City, NY is $159,500 to $213,900 per year, and in San Francisco, California is $166,800 to $223,600 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered. #J-18808-Ljbffr

W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed. Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters. Job Overview Job ID: J36993 Specialized Area: Data Science Job Title: Data Science Engineer - Machine Learning Location: To Be Discussed Later Duration: 7 Months Domain Exposure: Healthcare, Insurance, IT/Software Work Authorization: W-2 (Consultant must be on our company payroll. C2C is not allowed) Responsibilities: Help drive data science projects from concept, development, and deployment to production. Propose statistical or machine learning based model/methodology to solve the problem. Propose accuracy measures and validation criteria for the model. Implement and evaluate proposed model/methodology. Provide deep technical guidance and mentorship to the entire team. Work with product managers to formulate the ML product vision and design. Qualifications: Masters or Ph.D. in Computer Science, applied mathematics, or a related engineering discipline is essential. 4+ years building data powered products. Strong background in machine learning, statistics, and programming. Proven track record of analyzing large-scale complex data sets, modeling and machine learning algorithms. Expertise in at least one high-level programming language like Java, Scala, C++ or Python (NumPy, SciPy, Pandas). Expertise in at least one statistical modeling tool from among R, Matlab or Weka, is a plus. ROBOTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ROBOTICS TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ROBOTICS TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract. #J-18808-Ljbffr

LinkedIn was built to help professionals achieve more in their careers, and every day millions of people use our products to make connections, discover opportunities, and gain insights. Our global reach means we get to make a direct impact on the world's workforce in ways no other company can. We're much more than a digital resume - we transform lives through innovative products and technology. Searching for your dream job? At LinkedIn, we strive to help our employees find passion and purpose. Join us in changing the way the world works. Technology leaders collaborate, maintain balance, commit and achieve results - all while upholding immense pride in their quality of work. Our leaders value their craft and inspire their team to do the same. They balance product and technology strategy to put members first. They are responsible for attracting, retaining, engaging and developing their teams while also leading and inspiring them to achieve the goals of LinkedIn. Engineering leaders are champions of LinkedIn to their coworkers, their networks and the tech community. At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity, and the evolving needs of our business. This role may be remote or hybrid. At LinkedIn, hybrid roles are performed both from home and from a LinkedIn office on select days, as determined by the business needs of the team. Remote roles are performed from the designated home work location upon time of hire, and any changes to this home work location requires a review of remote status and approval. Job Description LinkedIn is the largest professional social network in the world. With the increasing complexity and diversity of our ecosystem across B2B and B2C, we need a highly experienced and visionary Distinguished Scientist to drive our strategies across business and technology, including up-leveling experimentation rigor and velocity, understanding and quantifying complex cause and effect in the ecosystem, as well as demystifying the AI system to identify significant opportunities. As a key leader in the organization, you will set a grand vision to connect the dots across marketplaces, shape Data Science tech roadmap, bring unparalleled expertise and strategic insights, influence the state of the art in the industry, and serve as an inspiring role model to grow future Data Science leaders. Qualifications Basic Qualifications: PhD in a relevant field or related discipline (statistics, economics, computer science, math etc.), or equivalent research experience 10+ years of relevant work experience Experience leading large-scaled technical projects with multiple stakeholders Preferred Qualifications: 10+ years experience in driving complex experimentation/causal inference design, methodologies, machine learning and measurement at scale, with at least 5 of those years in a technical leadership position Experience in driving both B2B and B2C product and tech strategies and solving ambiguous business problems through analyzing and optimizing two-sided marketplace Experience in driving large scale tech roadmap and partnering with horizontal platform teams to deliver high impact solutions Experience of technical leadership guiding and mentoring data science, engineering, and operations talent Experience leading high-impact, cross-company initiatives Suggested Skills: * Mentoring * Technical Leadership * ML/AI LinkedIn is committed to fair and equitable compensation practices. The pay range for this role is $238,000 to $390,000. Actual compensation packages are based on a wide array of factors unique to each candidate, including but not limited to skill set, years & depth of experience, certifications and specific office location. This may differ in other locations due to cost of labor considerations. The total compensation package for this position may also include annual performance bonus, stock and benefits. For additional information, visit: ************************************* Equal Opportunity Statement LinkedIn is committed to diversity in its workforce and is proud to be an equal opportunity employer. LinkedIn considers qualified applicants without regard to race, color, religion, creed, gender, national origin, age, disability, veteran status, marital status, pregnancy, sex, gender expression or identity, sexual orientation, citizenship, or any other legally protected class. LinkedIn is an Affirmative Action and Equal Opportunity Employer as described in our equal opportunity statement here: *********************************************************************************************************** Please reference ******************************************************************************************** and ************************************************************************************************ for more information. LinkedIn is committed to offering an inclusive and accessible experience for all job seekers, including individuals with disabilities. Our goal is to foster an inclusive and accessible workplace where everyone has the opportunity to be successful. If you need a reasonable accommodation to search for a job opening, apply for a position, or participate in the interview process, connect with us at accommodations@linkedin.com and describe the specific accommodation requested for a disability-related limitation. Reasonable accommodations are modifications or adjustments to the application or hiring process that would enable you to fully participate in that process. Examples of reasonable accommodations include but are not limited to: -Documents in alternate formats or read aloud to you -Having interviews in an accessible location -Being accompanied by a service dog -Having a sign language interpreter present for the interview A request for an accommodation will be responded to within three business days. However, non-disability related requests, such as following up on an application, will not receive a response. LinkedIn will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by LinkedIn, or (c) consistent with LinkedIn's legal duty to furnish information. Pay Transparency Policy Statement As a federal contractor, LinkedIn follows the Pay Transparency and non-discrimination provisions described at this link: ******************************** Global Data Privacy Notice for Job Candidates This document provides transparency around the way in which LinkedIn handles personal data of employees and job applicants: ***************************************