Category Theory
Zulip Server
Archive

You're reading the public-facing archive of the Category Theory Zulip server.
To join the server you need an invite. Anybody can get an invite by contacting Matteo Capucci at name dot surname at gmail dot com.
For all things related to this archive refer to the same person.


Stream: event: Categories for AI

Topic: Guest Lecture 3: Category Theory Inspired by LLMs


view this post on Zulip Bruno Gavranović (Nov 22 2022 at 14:21):

Hi all, just a small reminder that the guest lecture from @Tai-Danae Bradley will be held on Monday, 12th of December, at the same time as usual.

Title:
Category Theory Inspired by LLMs

Abstract:
The success of today's large language models (LLMs) is striking, especially given that the training data consists of raw, unstructured text. In this talk, we'll see that category theory can provide a natural framework for investigating this passage from texts—and probability distributions on them—to a more semantically meaningful space. To motivate the mathematics involved, we will open with a basic, yet curious, analogy between linear algebra and category theory. We will then define a category of expressions in language enriched over the unit interval and afterwards pass to enriched copresheaves on that category. We will see that the latter setting has rich mathematical structure and comes with ready-made tools to begin exploring that structure.

view this post on Zulip Pim de Haan (Dec 12 2022 at 10:17):

The talk will be live-streamed to Youtube: https://youtu.be/_LgWD3UTKfw
And available on zoom: https://uva-live.zoom.us/j/83816139841
Look forward to seeing you all today at 4PM UTC!

view this post on Zulip Bruno Gavranović (Dec 12 2022 at 18:37):

The slides and the recording are up on the website.