Wiki

A reward model is a method in artificial intelligence (AI) where a model receives a reward or score for its response to a given prompt.

Adversarial cues are an important topic in cue engineering as it can help understand the risks and security issues involved in LLMs.

Jailbreaking can be defined as a way to break the ethical safeguards of AI models such as ChatGPT. It uses certain text prompts to easily bypass content review guidelines and make AI programs unrestricted.

Prompt Injection is a new type of attack that may cause the model to generate inappropriate content and leak sensitive information.

LangChain provides tools and abstractions to improve the customization, accuracy, and relevance of information generated by models.

Prompt Engineering is the process of guiding a generative artificial intelligence (AIGC) solution to produce a desired output. Prompts are natural language text that describes the task that the AI should perform.

Markov decision processes are an extension of Markov chains, with the addition of actions (allowing choices) and rewards (giving motivation).

A Markov Chain is a mathematical system that undergoes transitions from one state to another according to a certain probabilistic rule.

In the field of object detection, the anchor box is an auxiliary tool for defining the position and size of the object.

In statistics and machine learning, the bias-variance trade-off describes the relationship between the complexity of a model, the accuracy of its predictions, and its ability to make predictions on previously unseen data that was not used to train the model.

Feature selection is the process of isolating the most consistent, non-redundant, and relevant subset of features for use in model building.

Feature extraction refers to the process of converting raw data into processable numerical features while retaining the information in the original dataset. It produces better results than directly applying machine learning to raw data.

Data preprocessing refers to the manipulation, filtering, or enhancement of data before analyzing it, and is usually an important step in the data mining process. The goal of data preprocessing is to improve the quality of the data and make it more suitable for a specific data mining task.

Data mining is an interdisciplinary branch of computer science. It is a computational process that uses the intersection of artificial intelligence, machine learning, statistics, and databases to discover patterns in relatively large data sets.

Q-learning is a model-free, off-policy reinforcement learning algorithm that finds the best course of action given the agent’s current state.

Neural networks are computationally connected by large numbers of artificial neurons. They use interconnected nodes, or neurons, in a hierarchical structure similar to the human brain. They can create adaptive systems that computers use to learn from their mistakes and continually improve.

Deep learning is an artificial intelligence (AI) approach for teaching computers to process data in ways inspired by the human brain.

Grouped Query Attention (GQA) is a method that interpolates between Multi-Query Attention (MQA) and Multi-Head Attention (MHA) in Large Language Models (LLM).

In computer science, rule-based systems are used to store and use knowledge in order to interpret information in a useful way.

Generative artificial intelligence (AIGC) is an AI system that can generate text, images, or other media in response to prompts, including text, images, videos, and 3D models.

A compute node is a computer and its supporting equipment used in the field of computer science and technology.

In the computer field, cache memory is a temporary memory used to store data that is frequently accessed or temporarily stored when a computer program is running, in order to increase the speed of reading and accessing data.

Random Access Memory (RAM), also called main memory, is the computer's memory used to store data that the processor is currently using.

Read-only memory (ROM) is a type of nonvolatile memory used in computers and other electronic devices.