LLM Search Product Manager - Vice President

Company: JPMorgan Chase & Co.
Location: Palo Alto
Posted on: April 2, 2026

Job Description:

Description You enjoy shaping the future of product innovation as a core leader, driving value for customers, guiding successful launches, and exceeding expectations. Join our dynamic team and make a meaningful impact by delivering high-quality products that resonate with clients. As a Product Manager in Global Banking (GB), you will be responsible to deliver a business-friendly, best-in-class enterprise Search capability incorporating the latest technologies (including AI/LLM) and applying best practices. You are expected to be involved in the design and architecture of the solutions while also focusing on the entire Software Development Lifecycle (SDLC) lifecycle stages. Job Responsibilities Develop and evangelize a clear product vision and strategy for Search and Large Language Model (LLM)-based conversational User Interface (UI) initiatives within GB. Align product goals with business objectives and market needs. Leverage wide range of cutting-edge technologies such as Semantic Search, Personalized Search, Supervised Fine-Tuning (SFT), Reinforcement learning with human feedback (RLHF), Retrieval-Augmented Generation (RAG), and Agents to deliver best-in-class user experiences. Work closely with internal stakeholders, including business leaders, data scientists, engineers, and designers, to gather requirements, define product features, and ensure successful product delivery. Oversee the integration and release of Search and LLM technologies into GB products and services. Ensure that solutions are scalable, secure, and compliant with regulatory requirements. Define and track key performance indicators (KPIs) to measure the success of Search and LLM products. Use data-driven insights to make informed decisions and drive continuous improvement. Required Qualifications, Capabilities And Skills 6 years of experience in Search / LLM product management with proven ability to lead and develop high performing product teams Excellent leadership and collaboration skills, with the ability to positively influence and inspire technology teams and stakeholders Strong track record of owning and developing a product domain strategy and roadmap. Able to balance short-term goals and long-term vision in highly complex environments Hands-on experience building Search and AI (e.g LLM) powered enterprise solutions. Expertise on the AI/LLM and data product lifecycle, spanning from discovery, data processing, model development, model deployment, and model monitoring Experience in any of ElasticSearch, Supervised Fine-Tuning (SFT), Reinforcement learning with human feedback (RLHF), RAG, and Agents Familiarity with LLM frameworks such as LangChain, LangGraph, and OpenLLM Knowledge of operationalizing AI products responsibly through MLOps pipeline Expertise in Cloud computing and architecture (e.g AWS) Preferred Qualifications, Capabilities, And Skills Experience in Financial Services or other highly regulated industries

Keywords: JPMorgan Chase & Co., Concord , LLM Search Product Manager - Vice President, IT / Software / Systems , Palo Alto, California