This blog post is written by AI CDT student, Fahd Abdelazim
Recent Artificial Intelligence (AI) advances have shown that the applications of AI extend far beyond increasing efficiency or convenience. It is now possible to use AI to tackle some of humanity’s most pressing challenges from minimizing pandemics to managing extreme weather events and guiding sustainable urban development. However addressing these issues requires specialized systems and skilled researchers to lead these innovations.
Recognizing the importance of tackling these challenges the University of Bristol established the AI for Collective Intelligence (AI4CI) research hub which will serve as the cornerstone for interdisciplinary collaboration and bringing together experts partners from across academia, government, charities and industry to work together to harness the power of AI to address the complex challenges which lie at the intersection of humans and AI.
For example, the personalization of treatment for diabetes patients and using data to enhance the NHS policies for patients. The hub will also work on enhancing pandemic prediction and response through analysing previous pandemics and exploring how AI can be used to help policy makers and healthcare professionals to make swift and informed decisions in the future.
Climate change is another pressing issue which increases the frequency and intensity of extreme weather events. AI can play a pivotal role in disaster management and mitigation through analysing real-time meteorological data to predict extreme weather events and provide early warnings. In the area of urban development AI can allow for more creating smarter and more resilient cities. This can be done through analysing population density, transportation routes and energy consumption. This can allow for optimized infrastructure and improved public services.
It is clear that AI will play a pivotal role in the process of building a better future and it is necessary to fully capitalize on the potential of this technology. Through initiatives like the AI4CI research hub we can harness the power of AI to address the future challenges that humanity will face and create a better and sustainable world for future generations.
tasks without updating their weights from examples given in the model’s input prompt. Models like GPT3 can perform in-context learning from small numbers of examples. Garg et al. presented an interesting paper that triez to understand what classes of functions can be learned in this way [1]. They were able to train Transformers that learn function classes including linear functions and two-layer neural networks.
Vosoughi [3] learns sentence embeddings usingimage and audio data alongside a text training set. The method works by creating pairs of images (or audio) using data augmentation, which are then embedded and fed through a BERT-like transformer to provide additional data for contrastive learning. This is especially useful for low-resource languages and domains, and it is really interesting that we can learn from different modalities without any parallel examples.
Many machine learning researchers are concerned with models that produce well-calibrated probabilities, but what difference does calibration make to end users? Vodrahalli, Gerstenberg and Zou [4] investigated a binary prediction task in which a classifier provides advice ta user, along with its confidence. They found that exaggerating the model’s confidence led the user to perform better. So, the classifier was uncalibrated and had higher training loss but the complete human-AI system was more effective, which shows how important it is for ML researchers to consider real-world use cases for their models.
deep learning aims to quantify uncertainty in complex neural network models, but is challenging to apply as it is difficult to specify a suitable prior distribution. Ideally, we’d specify a prior over the functions that the network encodes, rather than over individual network weights. Tran et al. [4] introduce a method for setting functional priors in Bayesian neural networks, by aligning them with Gaussian processes. It will be interesting to try out their approach in some deep learning applications where quantifying uncertainty is important.
few-shot generalization and personalization, which learns from semantic descriptions of classes, providing a way for instruct models through text. 
and constraints. She emphasized that the way people refer to desired actions provides important information about their preferences, and therefore we can infer, from a user’s language, reward functions that reflect their preferences. Aida Nematzadeh compared self-supervised pretraining to language learning in childhood, which involves interacting with other people. Her talk focused on the evaluation of neural representations, and she called for real-world evaluations, strong baselines and probing to provide a much more thorough way of uncovering the strengths and weaknesses of pretrained models.
techniques to software libraries and benchmark datasets. For example, PyTAIL [2] is a Python library for active learning that collects new labelling rules and customizes lexicons as well as collecting labels. Mohanty et al. [3] developed the IGLU challenge, in which an agent has to perform tasks by following natural language instructions; their presentation at InterNLP explained how they collected the data. The RL4M library [4] provides a way to optimize language generation models using reinforcement learning, as a way to adapt to human preferences; the paper [4] also presents a benchmark, GRUE, for evaluating RL methods for language generation. Majumder and McAuley [5] investigate the use of explanations to debias NLP models while maintaining a good trade-off between predictive performance and bias mitigation.
discussion – thanks to John Langford, Karthik Narasimhan, Aida Nematzadeh, and Alane Suhr for taking part, and thanks to the audience for some great interactions too. The wide-ranging discussion touched on the evaluation of interactive systems (how to use static data for evaluation, evaluating how well models adapt to user input), working with researchers and users from other fields, different forms of interaction besides language, and challenges that are specific to interactive NLP.