Artwork

内容由Carnegie Mellon University Software Engineering Institute and SEI Members of Technical Staff提供。所有播客内容(包括剧集、图形和播客描述)均由 Carnegie Mellon University Software Engineering Institute and SEI Members of Technical Staff 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品,您可以按照此处概述的流程进行操作https://zh.player.fm/legal
Player FM -播客应用
使用Player FM应用程序离线!

Using LLMs to Evaluate Code

1:02:10
 
分享
 

Manage episode 509954461 series 1264075
内容由Carnegie Mellon University Software Engineering Institute and SEI Members of Technical Staff提供。所有播客内容(包括剧集、图形和播客描述)均由 Carnegie Mellon University Software Engineering Institute and SEI Members of Technical Staff 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品,您可以按照此处概述的流程进行操作https://zh.player.fm/legal

Finding and fixing weaknesses and vulnerabilities in source code has been an ongoing challenge. There is a lot of excitement about the ability of large language models (LLMs, e.g., GenAI) to produce and evaluate programs. One question related to this ability is: Do these systems help in practice? We ran experiments with various LLMs to see if they could correctly identify problems with source code or determine that there were no problems. This webcast will provide background on our methods and a summary of our results.

What Will Attendees Learn?

• how well LLMs can evaluate source code

• evolution of capability as new LLMs are released

• how to address potential gaps in capability

  continue reading

174集单集

Artwork
icon分享
 
Manage episode 509954461 series 1264075
内容由Carnegie Mellon University Software Engineering Institute and SEI Members of Technical Staff提供。所有播客内容(包括剧集、图形和播客描述)均由 Carnegie Mellon University Software Engineering Institute and SEI Members of Technical Staff 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品,您可以按照此处概述的流程进行操作https://zh.player.fm/legal

Finding and fixing weaknesses and vulnerabilities in source code has been an ongoing challenge. There is a lot of excitement about the ability of large language models (LLMs, e.g., GenAI) to produce and evaluate programs. One question related to this ability is: Do these systems help in practice? We ran experiments with various LLMs to see if they could correctly identify problems with source code or determine that there were no problems. This webcast will provide background on our methods and a summary of our results.

What Will Attendees Learn?

• how well LLMs can evaluate source code

• evolution of capability as new LLMs are released

• how to address potential gaps in capability

  continue reading

174集单集

所有剧集

×
 
Loading …

欢迎使用Player FM

Player FM正在网上搜索高质量的播客,以便您现在享受。它是最好的播客应用程序,适用于安卓、iPhone和网络。注册以跨设备同步订阅。

 

快速参考指南

版权2025 | 隐私政策 | 服务条款 | | 版权
边探索边听这个节目
播放