使用Player FM应用程序离线!
Building a Local Large Language Model (LLM)
Manage episode 400056495 series 3429013
Another #ComputingWeek talk turned into a podcast! Two Red Hat software engineers, both recent graduates of SETU, returned to discuss the issues surrounding running your own LLM on a local machine, how models and datasets are built and reduced (quantised) so as to run on a laptop rather than an array of servers. Mark Campbell and Dimitri Saradkis provided excellent insight on the technical issues surround this topic, before getting into some of the ethical and moral issues with host Rob O'Connor at the end.
You can connect with all the people on this podcast on LinkedIn at:
- Mark Campbell https://www.linkedin.com/in/mark-campbell-76846b194/
- Dimitri Saradakis https://www.linkedin.com/in/dimitri-saridakis-32a087139/
- Rob O'Connor https://www.linkedin.com/in/robertoconnorirl/
Here are links to some of the tools referenced in the podcast:
- Red Hat OpenShift AI https://www.redhat.com/en/technologies/cloud-computing/openshift/openshift-ai
- LMStudio https://lmstudio.ai/
- Ollama https://ollama.ai/
- HuggingFace https://huggingface.co/
61集单集
Manage episode 400056495 series 3429013
Another #ComputingWeek talk turned into a podcast! Two Red Hat software engineers, both recent graduates of SETU, returned to discuss the issues surrounding running your own LLM on a local machine, how models and datasets are built and reduced (quantised) so as to run on a laptop rather than an array of servers. Mark Campbell and Dimitri Saradkis provided excellent insight on the technical issues surround this topic, before getting into some of the ethical and moral issues with host Rob O'Connor at the end.
You can connect with all the people on this podcast on LinkedIn at:
- Mark Campbell https://www.linkedin.com/in/mark-campbell-76846b194/
- Dimitri Saradakis https://www.linkedin.com/in/dimitri-saridakis-32a087139/
- Rob O'Connor https://www.linkedin.com/in/robertoconnorirl/
Here are links to some of the tools referenced in the podcast:
- Red Hat OpenShift AI https://www.redhat.com/en/technologies/cloud-computing/openshift/openshift-ai
- LMStudio https://lmstudio.ai/
- Ollama https://ollama.ai/
- HuggingFace https://huggingface.co/
61集单集
所有剧集
×欢迎使用Player FM
Player FM正在网上搜索高质量的播客,以便您现在享受。它是最好的播客应用程序,适用于安卓、iPhone和网络。注册以跨设备同步订阅。