Glossary/Technical

From Intersectional AI Toolkit


Intersectional AI A-to-Z[edit]

This glossary of terms for Intersectional AI A-to-Z is a great place to get started. By all means it's only one example of definitions for these complex ideas, and it is meant as an open invitation for conversations and amendments! These concepts show the complexity of the topic seen from multiple angles; yet it is so important to try to break down these concepts into plain language in order to offer more openings for folks to join these conversations. Please chime in, ask questions, help make these definitions better!

"it's often the way the technology is being used, rather than the technology itself, that determines whether it is appropriate to call it AI or not." (Elements of AI, Building AI)

"'[A]rtificial intelligence' means lots of things, depending on whether you’re reading science fiction or selling a new app or doing academic research. When someone says they have an AI-powered chatbot, should we expect it to have opinions and feelings like the fictional C-3PO? Or is it just an algorithm that learned to guess how humans are likely to respond to a given phrase? Or a spreadsheet that matches words in your question with a library of preformulated answers? Or an underpaid human who types all the answers from some remote location? Or—even—a completely scripted conversation where human and AI are reading human-written lines like characters in a play? Confusingly, at various times, all these have been referred to as AI. For the purposes of this book, I’ll use the term AI the way it’s mostly used by programmers today: to refer to a particular style of computer program called a machine learning algorithm." (Shane 2019, 7–8)

artificial intelligence[edit]

AI colloquially refers to various systems that look for patterns in provided data. These can appear from the outside similar "human" abilities such as "understanding" or "seeing." But these can be achieved through many different systems that vary widely from simple calculation a programmer would not call AI to complex programs that search for patterns without being given directions in advance. AI systems are often made up of multiple components of machine learning tasks and other techniques.


bias & variance[edit]

In a machine learning problem, bias is the technical definition for when a model is underfit to the problem, meaning it cannot find a pattern in the data (or can't find the pattern expected by the creator). This happens when there is not enough or not representative enough data used to train it.

Meanwhile variance or overfit, is when a model overstates a pattern, overcomplicating the relationships in the data based on what the creator's expected outcome.

As bias decreases variance increases, and vice versa. Other trade-offs include accuracy vs interpretability, complexity vs scalability, domain-specific knowledge vs data driven, better algorithm vs more data. (Rajati)

confidence interval[edit]

A range of numbers that helps describe how uncertain an estimate is. Any confidence interval has a high (e.g. 95%) chance of containing the true* value (that is, the accurate answer to the question being asked). So the bigger the interval, the more uncertain and the more doubt. Confidence intervals are used in statistics and in AI to determine a model (formula)'s reliability. *Classically presumes a hidden but "true" unknown value that is independent of the model (and this is not always the case of course). Unfortunately, uncertainty remains inherent in prediction and difficult to comprehend in models, even for researchers who create them (D'Ignasio & Klein 2019).

data cleaning[edit]

Data does not come in ready to go, it must be preprocessed. This includes many adjustments that can affect the outcome, including selecting a subset of data (sampling), standardizing and scaling it in relation to a baseline (normalization), handling missing data and outliers with decision trees (which Adrian MacKenzie calls "affiliated with arbitrariness"), as well as feature creation and extraction (discussed in F). The transformation of real-world information into "data" is never a neutral process but relies heavily on the conditions and goals of the research in context.

"there is no “neutral,” “natural,” or “apolitical” vantage point that training data can be built upon. There is no easy technical “fix” by shifting demographics, deleting offensive terms, or seeking equal representation by skin tone. The whole endeavor of collecting images, categorizing them, and labeling them is itself a form of politics, filled with questions about who gets to decide what images mean and what kinds of social and political work those representations perform." (Crawford & Paglen "Excavating AI" 2019)

explainability[edit]

feature extraction[edit]

Features are the items in a model that its designers decide are relevant,

GANs[edit]

GAN stands for generative adversarial network and is a now-popular kind of machine learning used to generate new data, such as images seen in the "AI dreaming" aesthetic. It requires two parts: One part is trained on existing data in order to check the second part's work. The second part is trying to generate new data that can fool the first part (hence adversaries).

hyperparameters[edit]

information[edit]

Claude Shannon... &/or vs intelligence

Javascript[edit]

k-means[edit]

& k-nearest neighbors

KNN is a lazy learning algorithm, which means it waits for test points, whereas eager learning generalizes and builds a model first.

loss function[edit]

machine learning[edit]

A field within AI that focuses on adaptive tools. These are "systems that improve their performance in a given task with more and more experience or data" (Elements of AI). "the “depth” of deep learning refers to the complexity of a mathematical model," (models) "Essentially all models are wrong but some are useful." (George Box) "Data science is a recent umbrella term (term that covers several subdisciplines) that includes machine learning and statistics, certain aspects of computer science including algorithms, data storage, and web application development. Data science is also a practical discipline that requires understanding of the domain in which it is applied in, for example, business or science (Elements of AI)

neural network[edit]

One type of machine learning that is designed with brain neurons as inspiration, neural networks move information through steps as many "nodes" in a process. These are weighted with probabilities and adjusted according to the expected outcome.

overfitting & underfitting[edit]

python[edit]

quantification[edit]

regression & classification[edit]

Regression tasks show the relationship between features in a dataset through ordering them based on a selected feature or features, for example sorting dogs by their age and number of spots. These are distinguished from Classification, which refers to specific machine learning tasks that label and sort items in a dataset by discrete categories. For example, asking whether an image is a dog or a cat is handled by a classification task. (Ciston 2023)

supervised & unsupervised[edit]

transformer[edit]

uncertainty[edit]

values & variables[edit]

(bag-of-)words[edit]

A natural language processing method of analyzing and classifying text that looks only at the frequency each word occurs, while disregarding the order of the words, syntax, or grammar—as if the words were all thrown in a bag.

X (as input)[edit]

Y (as output)[edit]

y = f(x) + Σ the simplest machine learning model looks like this. Written out it means that the output of a model is a function f() of the inputs x (which are also called parameters or features and are known) plus the error Σ (which is unknown). A function, here, just means that some calculation (algorithm, operation, recipe) is performed on the stuff inside ( ) based on what the model's creators have determined yields expected, "appropriate" results.

Z[edit]

REFERENCES[edit]

  • [Elements of AI]: https://course.elementsofai.com/1/1 *[D'Ignasio & Klein]: D'Ignasio, C. and Klein, K. 2020. Data Feminism. MIT Press. *[Rajati]: Rajati, M.R. 2021. Lecture. Machine Learning for Data Science, USC, Los Angeles. June 2021. *[MacKenzie]: MacKenzie, A. 2018. Machine Learners. MIT Press. *[Love Has No Labels]: https://lovehasnolabels.com/resources/glossary *[Excavating AI]: Crawford, K., & Paglen, T. (2019). Excavating AI: The Politics of Images in Machine Learning Training Sets. 2019, September 19. https://www.excavating.ai *[Shane]: Shane, Janelle. 2019. You Look Like a Thing and I Love You. Little, Brown and Company.