[go: up one dir, main page]

TSTR: Target Similarity Tuning Meets the Real World

Anirudh Khatry, Sumit Gulwani, Priyanshu Gupta, Vu Le, Mukul Singh, Ananya Singha, Gust Verbruggen


Abstract
Target similarity tuning (TST) is a method of selecting relevant examples in natural language (NL) to code generation through large language models (LLMs) to improve performance. Its goal is to adapt a sentence embedding model to have the similarity between two NL inputs match the similarity between their associated code outputs. In this paper, we propose different methods to apply and improve TST in the real world. First, we replace the sentence transformer with embeddings from a larger model, which reduces sensitivity to the language distribution and thus provides more flexibility in synthetic generation of examples, and we train a tiny model that transforms these embeddings to a space where embedding similarity matches code similarity, which allows the model to remain a black box and only requires a few matrix multiplications at inference time. Second, we how to efficiently select a smaller number of training examples to train the TST model. Third, we introduce a ranking-based evaluation for TST that does not require end-to-end code generation experiments, which can be expensive to perform.
Anthology ID:
2023.findings-emnlp.687
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
10256–10261
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.687
DOI:
10.18653/v1/2023.findings-emnlp.687
Bibkey:
Cite (ACL):
Anirudh Khatry, Sumit Gulwani, Priyanshu Gupta, Vu Le, Mukul Singh, Ananya Singha, and Gust Verbruggen. 2023. TSTR: Target Similarity Tuning Meets the Real World. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 10256–10261, Singapore. Association for Computational Linguistics.
Cite (Informal):
TSTR: Target Similarity Tuning Meets the Real World (Khatry et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-emnlp.687.pdf
Video:
 https://aclanthology.org/2023.findings-emnlp.687.mp4