Defensive distillation

Defensive distillation is a technique used to enhance the robustness of machine learning models, particularly neural networks, against adversarial attacks by training them on softened output probabilities. It modifies the training process to reduce model sensitivity to small input perturbations that can cause misclassification.

Read More →

Self-consistency decoding

Self-consistency decoding is a method used in natural language processing and artificial intelligence to improve the accuracy of model-generated responses by aggregating multiple outputs and selecting the most consistent answer. This approach enhances the reliability of language models by addressing variability in their outputs.

Read More →

Kernel inception distance (KID)

Kernel inception distance (KID) is a statistical measure used to evaluate the similarity between two sets of images, commonly applied in generative adversarial network (GAN) research to assess image quality. It compares feature representations using polynomial kernels on activations from a pretrained inception network.

Read More →