Graymatter Podcast with James Gray
Large Language Model patterns and more | Abhishek Kumar (Publicis Sapient, UC Berkeley)
Large Language Model patterns and more | Abhishek Kumar (Publicis Sapient, UC Berkeley)
LLMOps and strategies for leveraging LLMs in the enterprise

Abhishek Kumar

Abhishek Kumar is currently leading the AI and Data Science practice at Publicis Sapient as Director of Data Science. He leads engagements for numerous Fortune 500 companies on Data & AI strategy and large-scale implementation for areas in recommendation engines, anomaly detection, optimization, and recently in Generative AI. He holds a Master’s degree from the University of California, Berkeley, and is a recipient of the prestigious Hal Varian Award. He is also recognized as a Google Developer Expert-ML and featured in the Top 40 under 40 data scientist list. He has authored several popular data science courses and has delivered talks at global data and AI conferences. He is also a learning facilitator and instructor at Berkeley Haas Executive Education, focusing on the Future of Technology.

In this episode, we discuss:

  • What is LLMOps?

  • New components to the traditional MLOps infrastructure

  • LLM deployment patterns

  • Prompt engineering and management

  • Challenges scaling LLM-powered apps

  • How enterprise architecture will evolve

  • Human Reinforcement Learning Feedback

  • LLMOps is a team sport

  • Skills required for LLMOps

  • Use case and technology selection

  • Trends and opportunities for LLM applications

  • Change management and creative mindset

  • more!

Listen now on Apple, Spotify, and YouTube.

Where to find Abhishek Kumar:


Where to find James Gray:

Referenced in the podcast

Publicis Sapient:

DataHack Summit:

Berkeley Haas ExecEd Future of Technology:


Hugging Face:

Meta Llama2:

Weights and Biases:


Graymatter is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.


Graymatter Podcast with James Gray

Ideas, mindsets, and technology to innovate your best self and unlock high performance. From mastering yourself to mastering a craft you love.