Außerschulische Bildung 3-2024

Can we trust the trained weasel?

A practical approach to ethical integration of AI features

Nextcloud, a German independent software vendor, looks to offer AI integration to its customers in a way that fits its values of transparency, privacy and security. The firm develops collaboration software, with office and communication components. There are many opportunities to use AI in this space to help users work more efficiently. After internal and external discussion the company developed an 'ethical AI rating' to help administrators choose between AI solutions, and worked to offer privacy respecting options. Is it enough? What lessons can be drawn for the public and private sector? von Jos Poortvliet

The challenge

I imagine many of you have read about the challenges AI poses to society. Still I want to talk about them. In my experience, many people both over – and underestimate AI and its potential impacts on society. Most people don't realise how absolutely non-intelligent the large language models really are. „AI not intelligent like humans“, says UC's Anthony Chemero, University of Cincinnati (see Koenig 2023). „No, Today’s AI Isn’t Sentient. Here’s How We Know“ (Li/Etchemendy 2024). „LLMs have special intelligence, not general, and that's plenty.“ (Krishnan 2024) Access to this and all links mentioned in this article: 29.07.2024 But those who do, often go the other way, under estimating the impact AI still can and already does have on the world.

Let me first introduce the perspective from which I write. Nextcloud (https://nextcloud.com/about), the company I co-founded, is an organisation with a mission. We started our project because we saw the dangers of big tech firms dominating the market. We do not want to live in a world where 5 or 6 companies own all our data. Google, Facebook, Amazon, Microsoft – you know them. With their control over our digital lives come huge risks to our society.