BIG-bench
BIG-bench is a large-scale benchmark designed to evaluate the capabilities of language models across diverse and challenging tasks. It aims to provide a comprehensive assessment of model performance beyond conventional benchmarks.
language models
Cohere (company)
Cohere is a technology company specializing in natural language processing and artificial intelligence. Founded in 2019, it develops language models and AI tools for enterprise applications.
EleutherAI
EleutherAI is an open-source collective focused on research and development in artificial intelligence, particularly natural language processing. It aims to provide accessible large language models and democratize AI technology.
Prompt leaking
Prompt leaking refers to the unintentional exposure or revealing of input prompts used in artificial intelligence systems, particularly language models, which may compromise privacy, security, or intellectual property. It is a concern in AI deployment and development, affecting model integrity and user confidentiality.
Self-ask prompting
Self-ask prompting is a technique used in natural language processing where a language model generates its own intermediate questions to break down complex queries into simpler steps. This method aims to improve reasoning and answer accuracy by decomposing problems.