Large Language Models (LLMs) play a vital role in contemporary software development processes, particularly for code completion, generation, and debugging tasks. These AI systems support programmers by delivering precise, context-sensitive recommendations that optimize coding workflows and substantially increase development efficiency. This research concentrates on examining the Stack-v2 dataset to detect complex code patterns that typically result in inadequate completions from the model. We tackle these issues by refining the StarCoder-15B model with a carefully chosen portion of Stack-v2, specifically targeting challenging prediction scenarios. After fine-tuning, we assessed the model using the JavaScript component of the HumanEval-X benchmark. Our findings indicate enhancements compared to the original model, reaching a pass@1 score of 34.4 points. This confirms the efficacy of our focused fine-tuning method for improving LLMs to deliver more dependable and sturdy code completion in practical applications.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing JavaScript Code Autocompletion by Fine-Tuning StarCoder

  • Indranil Saha,
  • Susnato Dhar,
  • Subhranil Samanta,
  • Astik Mondal,
  • Snahel Patra,
  • Anasuya Sengupta

摘要

Large Language Models (LLMs) play a vital role in contemporary software development processes, particularly for code completion, generation, and debugging tasks. These AI systems support programmers by delivering precise, context-sensitive recommendations that optimize coding workflows and substantially increase development efficiency. This research concentrates on examining the Stack-v2 dataset to detect complex code patterns that typically result in inadequate completions from the model. We tackle these issues by refining the StarCoder-15B model with a carefully chosen portion of Stack-v2, specifically targeting challenging prediction scenarios. After fine-tuning, we assessed the model using the JavaScript component of the HumanEval-X benchmark. Our findings indicate enhancements compared to the original model, reaching a pass@1 score of 34.4 points. This confirms the efficacy of our focused fine-tuning method for improving LLMs to deliver more dependable and sturdy code completion in practical applications.